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ABSTRACT 



Factor analyses of two forts of the Gradu 
Examinations (GR£) Aptitude Test were urdertaker to bette 
the abilities affecting test perforoiance , Eesults suggest 
global abilities—two verbal and one guantitative—are cc 
tapped by the GRE Aptittide Test. Other less ftciinent 
diieusions-^some of which appear to te specific tc test 
forms-^-reveale d aspects of the test related to ftea type, 
speededness, and the contend of reading passages. Factor 
analysis was used to^estioate the loaoin^s cn these cpera 
factors of new itens frca eight experiaental tests adaini 
the operational forps* Statistical removal cf the extende 
fron the matrices of tetrachoric intferiteia correlaticns o 
experimental^ tests an4 examination of residual relaticnsh 

* amount of variance explained suggested that the experinen 
are, in general^ adequately* explained by the factors in t 
operational tests, Ihere are^ however, several dimensions 
experimental tests distinct from the factcrs underlying t 
operational forms. Reccmmendations based upcn these findi 

'conoetninq subtest length, item arrangement, and passage 
factor analysis method is relevant fcr supplementing aore 
i£em classification and analysis tecbnjigue^, and for the 
restructuring of the GRE Aptitude Test, (Au±her/ROP) 
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. • Abstract 

Separate factor analyses of tvo opera^onal forms 'of the, Graduate 
Racord Examinations (GRE) Aptitude Te^t vere. undertaken' ,gB.^ih^ a bettei? 
uirder standing of the abilities that contribute to performance on the examl- 
nation. Rasults suggest that three global abilities — two verba^l and one 
quantitative ~ are being consistently tapped by the GRE Apit^ude Test* 
Other less prominent dimenslcms — soise of which appe^ to be specific to 
test fanns " were noted also^ These dimensions revealed asjj^cts of the 
test ^at are related to item type> speededness ^ and the content of reading 
passages* , ^ ' ' 

Factor'exfension analysis was useci to estimate' the loadings an these 
operational ^test factors of new items from eight experimental tests administered 
with the operational forms^ Statistical rem£>val of the extended factory from * 
the matrices of tetrachoric interitem correlations of the experimental, tests 
and examination of, residual relationships and amount of variance explained ^ 
suggested that the experimental tests are^ in gerleral^ adequately explained 
by the factors in the operational tests. There are, however^ several dimensions 
in the experimental tests distinct from the factors underlying the operational 
forms* Recommendations based on the findings of the analyses are made 
concerning subtest lengthy item arrangement > and passage content* The factor 
analysis method' is seen as having relevance in supplementing more traditional 
item classification and analysis techniques and for the planned restructuring 
of the GRE Aptitude Test. ' L , , ' 
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Intro'duction 

Purpose 

The investigation reported herein is part of a multiyear plan aimed at 
rfevitaJLi2ing or renewing the GRE Aptitude Test (Altman et al-» 1975). The 
present study contributes to the reneval effort by (1) determining the factor 
structure of the current test and (2) deterroining the structure of several 
experiioental tests through relating each of these tests to thfe structure 
of the .current test. Since no factor analysis of .the GR£ Aptitude Tes^ has 
ever been reported* consideration of the current testes structure was thought 

to be useful in decisions regarding the addition of certain new tests or item 

^ j 

types and the deletion of others* A distinction between global , factors (such 
as verbal and Quantitative) and local factors (such as reading comprehension,' 
vocabulary, and verbal reasoning) was thought to be useful also. Local factors 
were considered to be of greater relevance to decisions regarding, the shortening 
of the current test» while the more global factors might have greater' value 
for deciding which additional modules should be included in any contemplated 
test' revision. Reference to previously .reported separate analyses of the SAT 
verbal and quantitative sections CCoffman, 1966; Pruzek and Coffman» 1&£6) did 
not yield conclusions that would apply without reservation to the GRZ^Aptitude 
Test» despite similarities between item formats of the two instruiafents. 

To accomplish the first purpose » principal factor solutions, based on 
interitem tetrachoric correlations* were computed for the responses of two ra^idom 
samples* each of 8*000 exAmii^ees* taking the GR£ Aptitude Te^st in October 1975. 
The second purpose was addressed by extending the current test's factors^ 
into each of eight experin^ntai. tests* which at each test center were 
administered in a spiral design in .eonjunction with the two operational 



fomis (See Table 2 J . Additional analyses of residuals were planned for any 
experissental tescs noc adequately described in cerms of the factors found in 
the operational tests. The factors extracted from the operational foxms, 
however^ accounted for sufficient amounts of variance in each experimeittal 
test to justify ^rostponing further analyses. 

Description of Operational Tests 

The operational portion of each GR£ Aptitude Test form consists of three 
separately timed sections containing ve];t>al and quantitative items > and is that 
portion of the test on which candidates* reported scores are based^ Section I, 
the first of two verbal -sections, is made up oi questions In three formats: 
analogies^ which test the ability to understand relationships among words and 
idea*; antonyms, which test vocabulary; and sentence completions > which measure 
ability to recognize logical and stylistic consistencies among the eleioents 
of a sentence. Section II > the second verbal section^ co.ntains paragraphs 
dealing with a range of subjects, each followed by sets of reading comprehenslcA 
questions. The Items liifSection Illy the quantitative section^ require 
reasonin'g based ot^an understanding of arithmetic, algebra^ and plane geometry, 
and the ability to ln>teT;5>ret data presented in ma^s, graphs > charts, or 
tables (Graduate kecord Exaaiinations, 1975). A tabular summary of the opera- 
tional test appears as Table 1 and examples of selected item types appear 
in Appendix A. These items have been extract^ed' from the Information Bulletin 

that is available to all GRE candidates. ' ^ ^ 

J 



Table 1 

Summary of th^ CRE Operational Test Forms K and K2* 



Section 



Item Description 



Form K 



Fonn K2 



Item Numbers 
Form K Form K2 



Time Limit 
In Hinutes 



4 



11 



III 



Discrete verb^: 

Analogies. 
Opposites , 

Sentence' completions ' 
Analogies 
' Opposites 
- Sentence completions 

Reading Comprehension: 

Narrative passage ^ 
Humanities passsge 
^Argutbentative passage 
Biological science passage 
Social studies passage 
Physical science passage 

Quantitative: 

Algebra, arithmetic, geometry, 

and miscellaneotts 
Data interpretation ' 
Algebra^ arithmetic, geometry 
Data interpretation 
Algebra, arithmetic , geometry 
Data Interpretation 
Algebr5, arithmetic, geometry, 

and miscellaneous 



Discrete verbal: 

, Analogies 
Cfpposites 

Sentence completions 

Analogies^ 

Opposites 

Sentence completions 

Reading Comprehension; ^ 

Narrative passage 
Scientific passage 
Argumentative passage 
Humanities passage 
Humanities passage 
Physical science passage 

Quantitative: ^ 

Algebra, srithmetic^ geometry, 

and miscellaneous 
Data interpretation. 
Algebra, arithmetic, geometry 
Data interpretation 
Algebra, arithmetic, geometry 

and misceliar^eous ^ 



1-55 


1-55 








1 fl-f Q 






9 0-17 


9 0-17 


38-47 


38-47 


48-55 


48-55 


1-40 


1-40 


1-7 


1-6 




7-1 1 




lA-20 




21-27 


97-11 


9 ft- 14 






1-55 


1-55 


-1-11 


1-22 


12-16 


23-30 


17-21 


31-38 


22-56 


39-44 


27-41 


45-5^' 


42-46 




47-55 





/ 



25 



50 



Throughout the report the two operational forms will be referred tp K End K2, The aizf^l GRE 
designation of these forms is, respectively, K-SCRl and K2-WGR1. 
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Description of the Eacperlmental Tests 

<i Section IV, ^he final section iti each GRE'^Apcitud^SI'&st book, has been 
termed an experimental test and designated - X^^, although the majority 
of the Items contained In these tests^ are similar to items In the operational 
form, and were being tried out in preparation for possible Inclusion In 
future operational forms* Two\iruly experimental tests (X^^^ and X^g) contain 
quantitative comparison Items — an Item tiype not used in the GR^ Aptitude ^ 
Test prior to October ,1977. The major experimental aspect of the other tests 
is the length o£ passages in the reading tests, the number of question^ « 
associated with each^ and the grouping of passages by content area — either 
scientific or humanities/social studies* A brles description of ^each 
Experimental tedt is given In Table 2. 

Sample Selection 

Samples upon which this Investigation Is based vere drawn from the popula-^ 

* * 
tlon pf examinees^ taking the two fortius of the GRE Aptitude Test that were 

given in October 1973* The ptlmary stratification variable jwas the experimental 

test fojnn chat the exaalnee received* The two^ operational forms and K2) were 

adainlsttired with the eight experimental tests> the latter being administered 

in a spiral design as Section. IV o£ th^ operational forms* That ls> approximate! 

half of th^ exaainees received form K and half received form K2. One of four 

experimental reading tests (X^q - X^^) occupied the final section (Section IV) 

of-form K, while one of four experimei^^tal quantitative tests (X^^ - X^^) w^s 

SectloiMW of form K2. Approximately one-eighth of the total examinee 

population was adalnlstered each combination (e/g* , form 1C, experimental 

test ,X^q) of tests. Random samples of 2,000 were drawn for each of these ^ 

combinat:ions» - • T ^ ' " 
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Table 2 

Description of Experimental Tescs 



Test, fotuL 



General Description 



No. of Items 



Time ^Lljnlt 
in Minutes 



^0 



hi ■ 



13 



^5 



16 



17 



Reading Comprehension (Humanltles/Social 
Studies) — three short passages, each ^ 
vith three associated questions- followed 
by two long passages (same length as 
operational fotm) each with sight 
questions ' 

Same passages as X.q> except each passage 
has up to two additional questions 

Reading Comprehension (Science) — thr^e 
short passages> each with three associated 
questlons> followed by two long passages 
(sfune length as operational form) each 
with eight questions 

Same passaged as ^^^^?^ tha't two 
additional short passages and^associated 
questions are added 

Regular quantltatlve^items paralleling 
those now used in the operational test> 
but not including da|a Interpretation Items 

Quantitative comparison Items 

First 23 Items ™ quantitative comparisons 
(suggested time 15 minutes) > last 12 items - 
regular quantitative Items (suggested tijae 
10 minutes^) . ^ 

Data interpretation items paralleling 
those now used in the operational test 



25 



30 



2> 



30 



30 



40 



35 



20 



25 



25 



25 



JJ/S ♦ 



25 



25 



25 



25 



\ 
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The two operacioaal fonns subject to the analysis reported herein-'were 
selected solely because their admiaistracioQ coincided with the proposed 
'research. These fonns,, therefore, were those on which the most recent data 
were available, ^ The fact that GRE test developer^ have* judged these forms 
to ,be representative of a larger aumber'of GR£ Aptitude Test forms justified 
a certain degree of generality for the results reported hereiiV; 

Categorization of Items 

Generally* data from three sources were used to interpret the results 
of the factor analyses of the two operational forms* Naturally, the 'test forms 
themselves ^d the categorization of items in these fontfs, along with the authors 
ji^dgments regarding the materiaj. contained in the tests, were the major inputs, 
Sel^ondly, the. test content specifications i^d by GRE examiners to 
items were obtained and scrutinized. Finally, the item statistics (biserial 

\ / 

cori;elat^ons of item with total test score, difficulty indices, and percentage 
attempting or reaching each item) al^o served as data useful in suggesting 
or confirming certain interpretations* Table 3 shows the classification categorj 
asscrckated witl) each item- type. ^ 



- 7 - 
Table 3 



GHE Aptitude Test Item 
Classification Scheme 



It^ Type 



Classification Categories 



Discrete 
Verbal 



Analo gies 



Opposites 



^ j (1) Level (concrete^ mixed, 
or abstract) 

(2) Structure (independent 
or overlapping) 

.\,(3) Content area* 

(1) Specificity (general 
definition or fine 
distinction) 

(2) Length' (single words 
or phrases) 

(3) Pa/t of speech 

(4) Content area* 



Sentence Completions 



(1) Number of blanks 
(one or two) 

'(2) Content area* 



Reading 
Comprehension 



Qunntitative 



(1) Passage cbntent 
(narrative^ biological 
science, physical 
science, synthesis^ 
argumentative > social 
studies, or miscel- 
laneous) 

(2) Item type (main ideas^ 
supporting ideas » 
intended inferences > 
application, evaluation 
of logic^ or style and 
tone) 

(1) Content (algebra y 

arithmetic > geometry > 
data interpretation. 
Or miscellaneous) 
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Aesthetic/philosophical » world of practical affairs^ science^ human, 
relationships, or general. 

-to* ' . 
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Form K - Internal Structure ^ * ^ ' ' - 

Estimated coraminalltles , obtained by Tucker's method (Appendix^),' were 
employed, leading to a total communallzy Estimate of nearly 60 or about 40% of th 
total normalized test variance of 150. The first 12 principal factors, derived 
irom the interttem tetrachorlc correlation matrix, were sufficient to account 
^ for virtually all of this estimated common variance. Inspection of the roots 
and trial rotation of 6, 3, 9, and 10 factors resulted in the^jre tension of eight 
factors, with total estimated communallty of 56*3, or 37.5% of the fotal test 
variance Vik% of the estimated common variance), (See Tables C-7 and C-8 
In Appendix C.) ^ 

^ ^il^ factoring of the common variance allows the parsimonious .description ^< 
of the relationships among test Items in a space of lower dimensionality, psycho- 
logical Inter^^retation of the resulting latent dimensions usually requires a 
rotation of axes to some criterion of simple structure. Since projection of 
the experimental tests Into the factor space determined by. the operational 
tests was planned. It seemed prudent to work with uncorreJtated (orthogonal) 
factors*. 

The most common analytic method for approximating orthogonal simple 
structure use? ICalser's (l958) varlmax cri^rlon, in which the variance of the 
column of s^tiares of item loadings on each factor is maximized. This procedure 
leads to item loadings near one or near zero on each factor and tenis „to result 
In relatively easily characterized factors with "clean" patterns of loadings. 
Although the patterns resulting from oblique rotations, such as Yates* (1974) 
geomin, are likely to be even more. Interpretable, the fact that the resulting 
factor structure Is not orthogonal could have led to difficulties In Interpreting 
the results of the ^tension of the factors to the experimental tests* Upon vari 
max rotation, the first three rotated factors vere founti to account for 76*5% of 

.17 



i 
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he common variance /while the'first five accoynted for 90.1% of thX^ common 
variance* 

The factors showed the Influence of item type and differential speedcdness , 
with, little evidence of covariance due to content classifications (See^Taljle 3) 
among fc)ie vertfSi items, but some indication of a content structure amoug the 
quantitative^ items, for whkch content and type appear to be more closely related. 

Th^S/rst three factorp characterize the major dimeusions of item coyarlahce 
and refect the global stn&cture of the skills assessed by the Aptitude Test* It 
would'appear that thre^ relatively Histtrict skills, one quantitative and two verbal, 
are being tapped. Alt^ugh the two verbal factors are not completely Independent, 
with all but two verbai^'Items displaying positive ^ loadings on both factors, a clear 
tendency is evident for completion items from Section I to relate more to the ^ 
reading passage items of Section II than to the opposites and analogies items ^ 
forming the bulk of Section 1+ The remaining factors account for relatively 
smaller proportions of test variance, revealing aspects of the structure of the 
quantitative test (Section III) and differential effects of speededness on 
the three sections. These latter factors id^tify additional dimensions of 
covariation within algebra, data interpretation, and applications ("word 
problems**) items, and separate speed factors for each of tKe two verbal 
sections. A discussion of each factor identified in form K follows below. 
(Also see Table 12.) Although t^e discussion fairly bristles with item numbers, 
item position is central to a major point, and we request the reader^s forbearance. 

Factor I, accounting for 28.3% of the common variance, underlies the common 
variance of the quantitative items, since mos^(43 of ^5) of the quantitative 
items, but none of the yerbal Items, load highest on this ^Zn^*i€iZ quantitativz 
^actcx.- Nearly all (53) of the quantitative .items display loadings of ,2 or 
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greater on Factor I» while only 12 bt the 95 verbal items have loadings this 
large* Items at Ghe*end of the quantitative section (*48» 51> 52» 53> 54, and 55) 
display the highest loadings on this factor, suggesting a strong relationship ' 
between speed and ability in this domain. While carrying th^ analysis out 
to 10 factors resulted ^in the splitting off of a speed factor tapping only 
these final items, this factor accounts for le^s than one- tenth .as much variance 
as was contributed by the quantitative factor, and the final items continue 
to represejtit the highest loadings on Factor I* It was concluded that the 
apparent sbeededness component among the ^quantitative items is not an artifact, 
but that alacrity i$ linked to rhe ability loeasured by this factor, (See 
Swinton and Powers, 1976,) ' * \' 

Factor II, accounting for 26.7% of the common variance > is a verbal . f^otQj:— ' 
^caddig comp^e/ieni^ccn; <Lonn<icXzd dcicou/ue, Thirty-eight of 40 reading passage 
items and all but one of the eight items in the first sentence-completion \, 
sectldn exhibit thei^r Highest loadings on this factor, with physical-sci^nc^- 
related reading passages appearing less stron^y related to this comprehension-, 
dimension than passages based on literary or social*'science content:* The ^ 
second completion section^ appearing at the end of Ejection I, shows substantial 
loadings (greater than .3) on this factor for only ^four of its eight items 
with generally much larger loadings on Factor V> a speed factox. Scattered 
analogies and opposites items, 01y 10, 23rV 30^ dnd 32) also have loadings 

greater than ,4 on this factor, but oUly eight >3f 38 Analogies and opposites 

- ^ - . 

items load hi^iest on Factor II, Only one ^aantitative itete has its highest 
loading on Facty* II, '\ ^ , ; ^ 

r ,. ' 

Factor III> accounting for 21;4JE of the common variance, reflects - 
vocabuZoKy: vco^ and ccncepii l^^v^Ation, Of the 18 loadings " 

i , * ■ ■■ 



above 16 are contributed by oppo^ites^ and analogies It^ms, The five 
highest; loadings on Factor -III 'are all contributed by opposites items- 
The tvo sets of sentence-completion items* which are associated vith the 
comprehension factor (Factor appear in a single timed section (I) of 
the test vith the analogies' and opposites it^ms; this ^ittiation might be 
expected 'to lead to moderate loadings from sentence-completion items on 
Factor Completion ^tems with loadings greater than -4 on this factor, 

are number^ 22» 27» 28> 53» 55, Eowever» only items 27 and 55 load highest 
on this factor, ' There is no evidence that single-blank completion items rel^e 
differently to th^s verbal reasoning factor th^n do double-blank completion ■ 
items, Items\in the oppdsites format generally exhibit their highest loadings 
on Factor Illy with 18 pf 20 such items loading higher on this factor than on. 
';any other; 12 of 18 analogies items also load highest on^ this factor* 
Of the reading passage items, only, two display loadings greater than •3 
on Factor III. The tw<i reading passage items having their highest loadings 
on Factor III are short questions, each having one-word answer choices involving 
rather difficult vocarbiilary* Loadings of these items therefore also tend to 
support the interpretation of Factor III as ^ ability to deal with wo^rds in 
isolation. 

Factor IV contributes 7,5% of the common variance, and displays loadings 

: / ■ c . , *^ 

greater than ^ 4 on items '3/5, 6, S, 9, IL^ 17, 20, and 21 of Section III. 

< \. ' ^ ^ ' 

* ■< ' . , 

In addition, ;tteiiis 1, 10, 29, and 32 exhibit loadings in the *30's. Of th'ese 
items , onl^^ numbers 6 and 10 do, not ^ Involve algebraic notation for the variables 
"x*' and "y"- E^c^ of the five lj£'ems Jiavjjfig.its highest loading on this factor 
'involved ^algebraic notatioit. Putting behfhd us the temptation to christen 
Factor IV/'thfe x factor," we dut> it e^epie>ttti/u/ otgiib^. The only other items 



In^Section III involving algebraic notation are items 30» 36» and 38» with 

loadings of ,22» ^28» and on Factor IV» and the more advanced it^ms from 

number 47 to th6 end of the test» which those pupils high in general quantitative 

ability were most likely to attenipt. These latter items load almost exclusively 

on Factor' I» th^ general quantitative factor. 

Factor V» accounting for 6,2>E of the conmion variance* is defined by the 

t 

fact ttiat its highest loadings are from itenis 48-55 > the sentence-completion 
items at the end ^f the 25-minute first section of the test. Loadings of these 
items on ^his factor range from .40 to /68» higher (except for item 55) than 
their Iqadings on any other factor* including verbal Factors II and III* 
In contrast to the role of speed in the quantitative test (an instrument in 
which the items at the *end appear to be the best measures of the quantitative 
factor) » these sentence**completion items show strongest covariation along a 
dimension orthogonal to other verbal items* suggesting that speed is a less 
central component of verbal ability* and that Sectioft^ 1^ with 55 items in 
25 minuted, ma|^ be more speeded than is consistent with optimal measurement of 
verbal reasoning. While ipeed xi^ponhz to dUoiZtz vQAbat may be an imp 

tant trait that adds to the validity of the instrument, the fact that 15Z of the 
♦ 

items in Section I appear to be strongly influenced by this factor may be of 
importance in the interpretation of the measu;re. The only other loadings 
greater than »2 on the factor appear in items also near the end of Section I, 
supporting the interpretation of Factor V as a measure of speed. 

Factor VI^ accounting for 4^3yl of the common variance, identifies a 
dimension of variance underlying quantitative items 12-15 and 22-25 two 
sets'of dat4 interpretation items, the first based on a rather unusual graph ^ 
and t)ie second on a parcel-post rate table. Each of the five items having 
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its highest J^oaddng on this factor is a data interpretation item. This 
factor seems to reflect obJjUXy to qjUuxcX ^^o.nmtion from a rather complex 
groundf since data interpretation items involving simpler tables or items 
requiring more extensive manipulation of information in add'ltion to extraction 
trom tables and graphs (itfems~16, 26» 33> 42-46) exhibit lower^loadlngs on 
Factor VX and correspondingly higher loadings on Factor I* 

Factor VII, accounting for, 3,1% of the common variance^ has no large 
loadings^ from any item* but a large number of positive and negative loadings 
ranging in absolute v^lue ftom -1 to -3 ~ loadings that are positive' for 
verbally-j>resented mathematics items* such as 6> 7» 10> 27 > 28» and 31> and 
negative for more abstract problems in^which algebraic, notation appears^ 
such as &y 36, 48> 49> and 51-^53. Only item 7, which is a relatively easy, 
practical word problem dealing vlth sales and commissions, has its highest 
loading on this factor. Three opposites and analogies items from verbal 
Section I display small positive loadings on this factor. 

Hie jsathematics content of the items with positive loadings on this factc^r 
tends to be practical: ratios » percentages^ and averages^ This fact, coupled' 
with the textbook "word problem" nature of the items, led to designating 
the factor as apptiaiXicri6 : i^ld p/ioblomy taken in a similar textbook sense/'* 

Finally^ Factor VIII accounts for 2,5% of the common variance. Items 

from the last passage of Section II are the only ones to show moderate (greater 

than .2) loadings oq this factor^ suggesting ^hat it represents a factor 

of tecuioig jipeed: comp^diOMion. Since all but one of these final i^ems (item 

f ^ 

38» which loads highest dn Factor VJII) display higher load^g^ on Factor II 
{rea(^ing comprehension)' than on Factor VIII» it was conc3,uded that reading 



^peed does not play an important role In Section IX* Examination of blserials 
suggests that reading speed seems neither to ^decrease/ final-item relations vith 
the Intended construct, as seemed' to be the case for Section I> nor to Increase 
those relations^ as did quantitative speed In Section III« Although, the content 
of these Items is scientific, and the other scientific passage also exhibits 
low loadings on the^omprehenslon factor. Factor Viy doi^5 not exhibit strong 
relations to the earlier sciei?tl?ic Items. Thus ,"^i^-content-related Interpre- 
tation Is less tenable than one based on speed. Furthermore, the Interpretation 
of Factors V and VIII as speed factors Instead of difficulty factors seems most 
plausible in light of (1) the appearance of large loadings at the points where 
the test becomes speeded > and (2) the fact that difficult Items appearing earlier 
In the test do not load on these factors. In addition, the Increase In loadings 
seems to correspond more directly to the sudden Increase In the test's speededness 
rather than to tke more gradual increase In the difficulty of items. A schematic 
summary of factor loadings of form K Items 1^ given In Table A* iJetalled tables 
of factor loadings appear in Appendix C. 



Form K2 - Internal Structure 

A second principal- factor solution^ again using Tucker's communallty 
estimates, was computed for form K2» and a total communallty estimate of over 
64 (43% of l50> the total test variance) obtained. Inspection of roots 
and trial va^imax rotation of 6, 8, 9> and 10 factors resulted in the reten- 
tion Pf the 10-factor solution as m^st meaningful. These 10 factors, with 
a.totail, estimated communallty near 61, accdunt for^AlX of the total variance 
or 95Z of the comnaon variance o^ the test. After orthogonal rotation 
according to the varimax criterion^ the first three factors account for about 



'Sunoftary of Factor Loadlnge of Item <^roape (Pona K) 



^'^aiogtes 
Opposites ' 
fonpl^t Ion 

Crpos Ices 
Cor:>l4it Ion 



Nat r ic tve J 

iMcJoriicai Science 
>< ci.tl ^Studies 
Phys IlaI ficlence 



Ct^nerai 




Words in 
Cor* text 

II_ 



-HS- 
+ 



++ 



Isoir.tlon 



'Algebra 



IV 



Seccion I 
Speed 

V 



Data Inter- 
pretati^on 

VI 



Applicatloua 
vs* Algebra 

VII 



4^ 



Section II 
Speed 

VHi 



rtigebralc *?^;>tatlon 
'^'11 Irt'erprctat Ion 
v'iitJinetlc (word problems) 
t 003^5 try and liiscellaneoua 



++ 
f 



(+)* 



_J_ 



Co<Jc; ^-H- » more than !ialf of the lo^^^dlr^Ks f,^o^ ^hene Ittui 
greater than ,4 and urorc than half h.i%*e their 
hi;;jie^t ioodlnge on this factor* 

» oitlier \\iilf of loadln;;3 greater than i4 or half loa^ 
hjp.hycc cti thlu factor. 



* - PobUivt '"'.idlafb fr^flj so".'^ t^s>rd 
abstract funct Ion i terns* 



^ J 



+ mr»r tl^.i 1m ] f 4jf I imp" \ny/i yrr ^trr r\.HY ^ J or -tM 
greater than >2* 



722 of the cotnmon variance > the first five for 84%, and the fir^t seven for 

92%-, Again the factors are. defined by item type* but there is little^ to. suggest. 

any differentiation aAong verbal items with ^respect to content classification. 

The content classification fpr quantitative items > on the other hand, is mor^ 

f:losely related to .the factor structure* ' • 

' The first three factors — one quantitative and two verbal " are similar 

^ ■■ 

to those of form K, reflecting the general skills that are tapped ^by the test 

and accoantlng for a relatively large (72%) portion of thfe comiDon variance 

■ 

of the items. (See rTable" C*9. ) The remaining factors', only one of which - 
acco^ifr'ts for more than 5% of the common variance > i;efle9t the speededness of 
each of the three test sections, two aspects of data Interpretation, an ability 

t 

to comprehend scientific material, and an ability to change response sets. 

Each of these ten factors Is discussed in more detail below, i 

Factor I, which accounts for nearly 30% of the common variance, is 

* * 

characterized by loadings greater than .4 for 40 of the 55 quantitativfe items 
and no loadings greater than *4 for aijy of the 95 verbal items. Only 3 of the ve 
bal items l6^d hi^hesb on thi$ factor, as contrasted with 47 of the ^Quantitative 
items. All of tHe" "remaining 8 quantitative items> which do not load highest on 
thija factodr^ have, been clasisified as data interpretation items.*. Factor I, 
therefore, wSa termed qtnvial ^vMfUatLvt CLbltlty, although there is some indioa 
that algebraip items are instraoental' in its definition. This indication is 

^ggested, by the fact that > of - Factor I's seven highest loadings (greater than 
.7) four come from i'f ems -classif led as algebraic in content. Factot; I also 

.seems to reflect a speededness component linked to quantitative ability, 
since seven of the fi^al ll items have loadings ^greater than .6 (whereas 
less than one-foftrth of "the earlier itams have loadings this high). 



^BXi.f^ Z2% of the connnon variance is conVtfbi^ted by the second factor. 
Factor II is clearly a verbal factor, sin^e none of the quantitative Itettts 
displays its highest on II (and none loads greater thai^ t bat 42 of the verbal 
i^^ms show their' heaviest loading on this factor, .Twenty*-five of tbe"^^ 40 
reading comprehension items exhibit their highest loadings on this factor, 
alongr with s^ve'n of the first xiHae. sentence^-conipletion it^ms. Of the 15 reading 
comprehension items that do not relate most strongly to Factor II, 13 aft 
items associated with two scientific passages, instrumental in defining 
two subsequent factors, Ttte six highest loadings on Factor II come from 
reading comprehension items (^3/ 1$, 23, 24, 2$, 29) a3sociated with passages 
containing humanities', narrative, or argmneBtati^ content. Factor II is, 
therefore, thought to reflect an ability to. deal with connected discourse. 
This factor seems to' relate closely to what is commonly ^referred to as reading 
comprehension'' and has thus been termed ^^oxtuy compte/ioU-it^Jt: cortrtcotcct 

1^ Factor III, accounting for 19,4% of the common variance, emer^ges as a, 
second verbal factor, with none of the quantitative items having loading^ 
greater thdn ,2. Furthermore, bnly two redjjing co^jjj^&iension items (#26, 33) 
load highest on this factor and none have' loadings greater than .4. Similarly, 
only four of the 17 sentence-completion items, have loading^^reater than ,4 

.and only four of tl^e itesis (i?22, 27,^33, 33) have their highest loadings 
on Factor » This pattern suggests that Factor ^I£ is most clearlry defined 

by Che relatively large number of hl^h loadings on opposites lt8;ms and, to ' 
a lesser extent, by high loadings on analogy items/ This factor, thereforey 
is thought to reflect an ability to deal with wtfrds in isolation or vocabulary, 
narrowly defined. This ccfntentlon is supported by the nature of the opposites 
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items » which rely W li^abulary kno^^edge» and on the nature of ^ , 

analogy items* which re^juire both acknowledge of vocabulary and an ability 
to determine relationships* The fact that the analogy iteitis have a lower propor- 
tion of high loadings than do opposit^s items supports the interpretation of Facto 
III as a vocJXbaZoKif: m^d^ OJid concepts in A^oZation factor. The interpr*Vtation 
is further substantiated by examining the two reading comprehension items 
iif26y ^) and the sentence-completion items (#22» 27, 53» 55)» which have 
their hJLghest loadings on Factor III* In general* these items seem to include 
relatively difficult vocabulary in either the item stem or the answer choices* 
On thte other hand* 10 of the 17 analogy items and 13 of the 20 opposites items 
hay^loadings gr^^^^ than and 10 ^alogies and 14*opposite3. items have 
theJ^r highest loadings on this factor. 

Factoi; IV accounts for a significantly lower proportion of Variance 
(7, Tit) than any, of the previo*us three factors* was» hotter* fairly 
easily interpreted by virtue of its high loadings from the last third of 
Secti^^V^I^ (which includes both opposites and 3entence-co«pletions) and the 
absence of 16a4ings frpm any other it^ms — either verbal or quant^jfative , 
SpecificA^l^^l;^, of Che last 18 items oiT Section I, have loadings^ ^eater than .2. 
These are a^o\the only ^qadlngs great^ than *2 on this factor. Seven of 
these item^ (^d six of the last eigjht) exhibjit higher loadings on this factor 
than on any other* Factor IV is» therefore* interpreted as ^eipOrtiC 4p£ecf 
associate4'wi^(|Sect:ton I of the test* thus resembling Factor V of form 

^ Factor, V^. whiitfi^co^ntributes 4..42 of the common variance* is by virtue of its 
loadings interpr^^jtbd a^' a second speed factor {di^cxztQ^iojxduig iip^zd) associated' 
with Sectioa IX. iThk only Items having loadings greater than *2 and/or loading 
highest on Factor^ tM fi^al reading-w^ompret^&nsion items In Section III. 
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The iasi seven have loadings greater than *2 and the last six hav^ their highest 
loadings on Factor V. Thls^ factor Is comparable to Factor VIII of form K* 

Factor VI contributes 4*4% to the common variance of the test* Of the 13 
quantitative items that show loadings of .2 or higher, nine are data Interpre- 
tatlon Items-^ All six items with loadings greater than +4 are of this Item 
type an^ the^three hlgliest loadings on Factor VI coioa ftom items 25 > 27, and 
42 all d^ta inteirpretatlon items* Data interpretation items 25, 27, and 41 
have higher loadings on this factor than on any other. Beside^ the data 
interpretation items , only four other ^quantitative Item^ hav^ loadings greater 
than *2 oit this factor (althoiigll^none of thtee loadings represents the highest 
loading for any of^ the four items)* ^ Three of the four items are the last 
three in Section III, suggesting that a slight component of speed ntLght be 
present in the factor* Item analysis statistics, which show that the percentage 
of examinees attempting each item decreases very rapidly at this point in the 
test, support this interpretation: approximately t^o-^thirds of the examinees 
attempted the antepenultimate item and fever than h^f of them attempted the $ 
last two items* However, since Factor VII also seems, to be chatacterlzed 
by loadings from data interpretation items ^ it was necessary to determine the 



distinguishing features of each of these **data interpretation" factors. These 

. > * 
distinct characteristics are discussed t^elow* ^ 

Factor VII, the second data interpretation factor^ Accounts for only a 

slightly smaller percentage of common variance (3*9%) than Factor VI," 

the first data interpretation factor. Factor VII is defined by six items ^ 

all data Interpretation Itein^ having loadings of *4 or more* Only four 

items (//23;^ 24*, 26, and 39) have thefr highest loadings on Factor VII, but 
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all^ are data interpretation items » and Factor Vll's^two highest loadings 
(wtiich ai;e both greater than .6) are from data interpretation items. 

The iten^ instrumei^tal in defining Factor VI (i,e.» it^i&s ^ *^ 

*^ 

25, 27, 41f and 42) reqiilre the e^minee to extract information from 

•\ 

graphs or tables and to perform one or more simple arithmetic calculations 

^ order to answer the items* Items^^23f $^|^6 « and 39* on the other hand, 

\ V ^* ' ^ 

require oaly extraction of information'^rom the graphic or tabular matej;ial* 
Factor VI» therefore* has been calied'^?^tta^iinie^ QjU^ction and 

mjupa£4-tccrt» whereas F^?|or VII has ^^^^ termed simply diUn. intvipxttation: QXtX 
tijon* These ^factors ara ^qK(i?>arable to undifferentiated Factor VI of form 

Only seven items haVyio^Sings greater than -2 on Factor VIII» vhich 
account^' for 3*1% of ^the '^rt's common variance* All the loadings come from 
seven it^ma (7>^I3) asaoc^^^d with the highly technical first sclenti-fic 
passage^ whichr'load higher on, Factor VIII than on any other. This phenomenon 
suggests that the factor reflects an ability to comprehend^ scientific or 
technical proae. Somewhat contradictory to this interpretation ia the fact 
chat items asso<fiated with the second scientific passage do not load on 
this factor^ The apparent anomaly may be explained by the f act ^that the latter 
items app^r at the end of Section II >and load on the speededness factor 
(factor V) discussed abovE. J^parently, then, doing well on these items Is 

i 

more dependent on speed, under existing tim& limits, than on ability to 
^rehend scierttific material* Factor VIII, however, may be explained by 

appeal to content* It is, of course, possible i^hat this factor ia specific* 

* * 
Factor VIII has thus been termed viajdJjiQ comp^xe/icni^rtr 4cieJitc(i^/^e.c/irt^aii. ^ 

Factor IX*, accounting for 2*5% of the varianQe,«is a .bipolar factor defit^gfl^ 

exclusively by ten (piantitative items having loa^lings greater In.abadlute ^ 

Ttilue than -2, Although none of these items loa<J hi^est on this f4<:tor. 
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the interpretation of It as a quxintiXaZLvZ ^pecxi factor Is straightforward* 
Two early qtiantltatlve Items (#6,7) have loadings less than -2, ,^hlle eight 
of the last ten Items have positive loadings greater than .2. Item aaalyses" 
statistics support this Interpretation, since loadings greater than ^2 do not,, 
appear for any Items attempted by .more than 90% of the e^caminees, but they are 
apparent for all of the six Items attempted by less than three-qt:arters ^of the 
sample, ^o comparable factor was retained in form K> although Factor VIII 
of the lO-faQtor trial solution had a similar Interpretation. 

The final factor> Factor X, which accounts for only slightly more than 
2% of .the common variance of the test, was somewhat^^dlf f icult to Interpret. 
Only five ltems> all of which are of the opposltes format, have loadings 
greater ^c^an .2 on this factor. These Items Include the first two in the 
first opposltes section and the first three In the second opposltes section. 
Somewhat problematic In Interpreting this factor> however. Is the confounding 
of Item difficulty and position. That Is, these five Items are also the easiest 
of the 20 opposltes Items. This factor has thus been dubbed QJidy Oppc^-Ltu, 
although the authors' own response tendencies were to search for synonyms 
Instead of antonyms when attempting Initial Items of this nature. This 
tendency probably results in part from the response set that Is established 
by the analogy Items that precede each of the opposltes sections. The 
factor might thus represent a wani-^up phenomenon for this Item type. Never-* 
theless> Interpretation In t^rms of difficulty seems more parsimonious. 
Table 5 summarizes the loadings of groups of Items on the factors for form K2. 
Detailed tables appear In Appendix C. A summary of the factors In forms 
K and K2 Is presented in Table 12. 



*ro det^rmin^ the structure of each of eight experimental teats ' 
or, more specifically, to determine whether any experimental test reflected 
dfiaensions not shared wflh the operational forms, a factor extension analysis 
was perf^oTteed. The factor structure in each operational forft was extended 
to each of the four experimental tests that had been administered in a spiral 
design with each operational^form, 

Aftar the matrix of fadtor loadings was obtained, item responses to each 
of the four associated optional tests were located In Mihe factor space of the 
operational test. This factor extension technique (Dwyer, 1937; Harman, 1938) 
results in an augmented matrix, in which the factor extension matrix consists 
of the loadings of each experimental test item on each operational test 
factor* 

The product of the extension matrix and its transpose is an estiioate of 
the Intercorrelation matrix of the 'items of that experimental test, based on 

\ 

only those dimensions of item covariance that are shared with the operational 
test. The residual correlations and reproduced item communalities may 
be examined to determine the degree to which the experimental test reflects 
other dimensions not shared vith the operational test. The variance 
accounted for by each factor of the operational test give? a measure of the 
relative jbiiportance of that factor in accounting for the common variance 
shared by the two Instruments, In general, this shared common variance will 
be less than the total common variance of the experime:ntal test. To the 
extent that factors of the operational test can be interpreted meaningfully, 
the pattern of fa$;tOr loadings In the extension matrix may be employed to 
examine the construct validity of the experimental Instrument, It should be 
noted that for each operational test, the same factor matrix, based^ on 8,000 



cases^ has bean employed with each of the £oui^.2,000-caadldate random subsastples 
Thus the validity of the analysis depends on the assumption that the structure 
of operatiDn^J forms is identical for each experimental test group', a reasonable 
assumption considering the sample size and the spiralling assligment technique. 

We first discuss th^e^cperimental verbal tests^^iveg^wlth form K 
of the operational test. For each experimental test, ve examine the degree 
to wbich it^ coinmon variance is "explained" by* that of form K> and the relation- 
ship of each testes items tio the structur^e of ^that form. The experimental 

mathematics tests > given with form K2 of t^e operational test, are then ^ 

\ 

related to the slightly more compiax structure of form Comparison of 

results between operationa^g tests depends even more on randomness of sample 
selection and size than do comparisons among experimental tests within each 
operational form. As noted on page 6, the analysis also depends on the presumed 
representativeness of the two operational test forms. 



Results of Extension Analysis: Verbal Instrijfeents 

Candidates receiving operatiodal test form iC were divided randomly into 
fodx subgroups. Each was administered a different 25-mlnute experimental 
verbal instrument after completing the three operational sections. The 
experimental tests differed in item type and content, as indicated let Table 2 
and sumDarized in Table 6. 



i. 


^ Table 6 ^ 
Summary of Experimental^ Verbal Teat^^*'^ 


'Experimental 
Tests 


No, of 
Items 


Descriptl^oQ - 




25 


bitmaiiities /social studies content (three short- 
passages, two long passages) , ^ 


t 


30 


identical to X^q ^cept fpr f ive ^additibnal 
questions 




25 


science content (three short passages, two 
long passages) , ^ 


1 


30 


identical to Xyi except for two additional 
short passages ^d five additional questions 
^ 



For Che present study, samples of 2,000 candidates were used for each 
subgroup* Table 7 displays means', standard deviations, and correlations for 
these sami^^es. 



Table 7 

Descriptive Scacistics for Experiment^ Verbal Tests- 
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The means and standard devlatloos indicate that the four subsaniples 
are quite comparable. The X^^ group is approximately one point lower than 
the other groups on the verbal rest^ ^difference barely significant at ^ 
the ,05 level because of the large sample size. This group is also lover ^ 
on the quantitatifve test than is the X^^^ group (t^jjg ■ 2.5). However, the 
difjference of .82 of a point does not suggest any systematic difference 
in the samples. Correlations of ^he verbal and quantitative tests are almost 
identical in the four subgroups. A systematic difference appears between the 
correlations of the humanities passages tests X^^ and X^^ and the science passages 
tests ^3 operational tests. The experimental tests 

based on humanities passages correlate .83 with the operational verbal score> 
but those based on science passages correlate at a significantly lower .77. 
However^ the humanities passages show correlations of about .A5 with the'" 
quantitative score> while science^based passages display coefficients a full 

^ 1 

.10 higher. Although these latter correlations are comparable to the V-q 



correlations obtained ♦from form K> the lower reliability of^ the shorter 
experimental tests suggests that even greater discrepancies might have 
resulted from a longer operational form. Thus> any plan to allow 
candidates to select passages should take Into account the different 
characteristics of science^^based passages -* a difference apparent in the 

factor structure of "both operational f orma > the correlations discussed above> 

I 

and the following extension analysis. 

The eight factors of operational form K vera extended into^the space 
of tetrachoric Interitem correlations for each experimental test. Table 8 
gives the proportions of variance accounted for by this procedure. Item - 
loadings of each experiinental test on the operatioi)aJ^ factors appear in 
, A^ltendix D. 
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Table 8 



Variance of ExperlaifintaJ; Verbal Tests Explained 
{ * by OperatioaaJi Test Pactors: Form K 





* 


10- 


11 


12^ 


13 


?^Ho, of items " Total ^Variance 


25^' 




« 25 


■ 30 


Common Variance* 


■ 10.91 


13.34 


11. 57 


13.83 


Common Variance as a Percentage of 
Total Variance 




44.47 


46.30 


46.09 


PercentaJ?e Common Variance * 
Explained by: 










Factor I 


General Quantitative 


2.17 


5.22 


11. 58 


y .u J 


II 


Reading Comprehension: Connected 
Discourse 


51.95 


46.38 


46.64 


35.17 


III 


Vocabulary: Words in Isolation 


U.80 


14.75 


5.76 


7.71 


IV 


Elementary Algetra 


2^39 


t .38 


2. 74 ' 


2.77 


V 


Discrete Varbal Rsspcnse Speed 


2.84 


2.85 


1.82 


2.94 


VI 


t 

Data Interp^retation : Information 
• Extractio^^ 


1.39 


1.30 


.95 


2.25 


711 


AppULcatioQs ; ^ord |;]:pblems 


2.10 


.96 


.85 


.91 


Tin 


Reading Speed: Contprshension 


2.85 


3.24 


5.71 


4.19 


Subtotal Verbal Pactors II, III, V, Till 


(72.44) 


(67.22) 


(59.93) 


(50.01) 


Subtotal tjuantitative Factors I, IV, 71, TL\ . 

* * * 


( 8.04) 


( 7.86) 


(16.12) 


(14.96) 


Total (Percentage Common Variance) 


80.49 


75.08 


76,05 


64'. 97 


Percentage Total Variance ^ ^ 


35.13 


33.39 


35.21 


29.94 



Common variance estimated as the sum of Tucker s highest adjusted off- 
diagonal estimates of coiimxunallty^ . 



' Arranging the tests as in Figure 1 illustrates- the manner in- which content 

and speed dimensions jointly affect variance shared with the operational test* This 

« 

illustration is analogous to a two-way analysis of vaniance.^ 
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Figure 1 

Interaction of Test Length and Content M Accounting 
for Variance: Form K 



(a) 

Percentage of Variance Explained 
by Verbal Factors 



<b) 

Percentage of Variance Explained 
by Quantitative Factors 





Humanities 


Science 




Humanities 


Science 


25 Items . 




59.93 


25 Items 


1 4 ] 

8,0^ 


16,12 


30 Items 


67,22 


50,01 


30 Items 


7,86 


14,96 



Averaging over the tvo humanities tests in column l-'of Figure la, 
we find that verbal factors extended from the operational test account for 
6S,8^ of common variance and an average 55,0% for the science passages ^ 
in column 2. Averaging over rows, we see that the two shorter tests 
have an average of 66,2% of common variance accounted for by verbal factors, 
versus 58,6% for the two longer tests. The pattern apparent in Flgura 1 
suggests an Interactive" effect of test length (speededness) and test content. 
That Is^ lengthening reading comprehension tests seems. to change the 
structure more drastically for tests with scientific content tjian for 
those with humanities conten.t, . , , 

When the variance explained by factors extended from th^ quantitative 
operational test is exsmined, speed appears to have a' smaller effect on the ^ ^ 
variance explained, although dcienc£ pasrages in column 2 of Figure lb again 
seem t^^be more affected by test length, but qontent has an opposite effect ^ 
on common variance from that of verbal .factoj^^n, Quantitative factors explain 
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an average 8.0% oE the variance of the humanities items in columi 1, but 15.5% 
of the variance of the^ two science tests* "^t appears that science passages 
are different f rom^humanities passages and that the difference increases in ^ 
the face of speededness, if arguDient by analogy to interaction ia the analysis' 
of variance* is appropriate* ^ 

Although form K does not exhibit a factor identifiable as "science 
Passage*," Factor VIII, a-speed factor, has largest loading^ on the items Cf 
a science passage at the end o,f Sejtion m. form K2 does exhibit a science 
factor separate from reading speed. However, since form K2 was not given in 
conjunction with experimental verbal tests, it was not possible to determine 



e^£ 



how much factors of K2 would ei^ain the variance of tests X^^^ ^-^y 
If form K2 should relate differently to these tests, it would be 
necessary to question 'how parallel the two operational forms actually 

are * , \ 



Residual Correlations among Items within Experimental Verbal T^sts (X^^ - X^^) 

^ Test X^Q is experimental in that it contains three reading'^pa^ages, 
each approximately one-third ^s long as those in the o(Terational test/Ngach 
passage in X^q has been classified as humanities or social s^tudies in^ 
content:^ In terms of the magnitude of residual correlatioi^s* among^^tems 
in X^Q, the eight factors extracted from -operational form EC at)pear to do 
an excellent job of explaining the variation in test X£^^ slice only 17 of 
tfie possible 300 residual relationships are' greater than .10. 



*The difference between. the observed correlations among experimental test 
items and the correspoiyiing correlationS'''fepl^i?duced. from the loadings of / 
experimental items on ^he factors in the operational 'form. 



The only unexplained .relationship among item^^is a ^peed component peculiar to 
this test^ This component is suggested by the pocedoininanca of large (greater 
than .10) residuals amonS the last eight items (12 residual relationships, 
greater than ^10)* Items associated with the new, shoreS: passages In test 

are explained quite adequately che factor structure of ttie operational 
test,* since only one of th^^^ residual relationships is'^ greater than .tlO. 
m Tike experiment arl' reading comprehension test» X^^^ is the same as 
except for an additional question added to^each passage, thus increasing 
the test length, to 30 items* Fifty-five of the 435 «sldual correlations 
are greater than .10 and 10 are greater than .20 for this test* A component 
of speed associated with is apparent since 30 of 36 residual correlations 
aisyong the-last irf^ie items are greater t^han -10* The variance contributed ^ 
by the 12 Items based on the short passages seems less well explained 
by the factors from the operational test than is that of the nine corresponding 

items in test X^q, since six of the 66 residual correlations among these J.2 

^. * ' ' 

items are greater than .10. Kalationships among the items fo;: the longer 

pa^a^es also seem less' thoroughly explained* It appears then, that 

speeding the test by adding items ma^ introduce tvo components related ''to 

speed — one having to do with reach^g or^attempting the final items and ' 

one with time spent considering each item. 'That is,*an addit'ional 

component, which we call dAJ>t/LU>atLv^ ipee^rf,. emerges when examinees have 

less time per item* 

' Test X^2' ^ 25-item te^t rfequirtng reading of scientif ic-tephnical 

material, is less fully explained by the eight factors than 'is X^qj -a 



25**lCtiii reading comprehension test don&a^Aing hunianlCles/sDcl^x studies content 
Thirty**nine of 000 residuals aire greater than ^10, and six are greater than^ 
.20. Oniy^''^ar-"'of the ^ residuals among the items, following short passages 
are greater than .10; so it appears that ^l^creasing the length of passages 
does not add any component of variance chat i& not explained by the eight 

^ . . . . . f 

factors esttracted from the operational test. 

A high proportion^ (16 of 28)^of large residual correlations among the 
last eight items, u^ich are associated vitfi the final passage, suggests a 
* distinct con^one^ of speed peculiar, to this test, since item 18 is the point 
at which the number of examinees not attempting items increases sharply, 

' f . 

although this unexplained Variance could also be due ^o the nature of the 
passage. ^ - ^ 

fin even higher proportion (17 of 28) residuals greater than .10 (four 
are greater than ^^O) appear in the relationships amgyg the eight items 
associated with the next to last passage " itel&s th^tVre attempted by nearly 
all the examinees ♦ This pattern suggests that this long scientific passage 
contributes test variance not expiated adequately by the eight factors 
found in the operational torm* This particular passage seems to be the most^ 
technical of any of the passages in^^t^he sense that it ct>n tains a relatively # 
large mumfaer of highly techni£:al terms (e.g., names of chemicals, types of 
bacteria) . * 

The firif short passage also contains more technical terms Xhan ariy of 
the other shottj passages, and it, too, is not as fully explained as the other^ 
technical pass§/ges^ In summary, the only relationships aiDong large residuals 
seem to be their connection with specific passages. ^'That is, no specific i 
item type seems less well explained than' any other. 
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Test Xj^2' which is the same, as test X^^^ except for two additional, short 
passages and five additional questions^ is characterized by a relatively large 
number of large residuals. Of the 435 \[^esidual correlations, 66 are /greater 
in absolute value/^than ,10 and, in fact, eight of these are greater than 
*30* There are ffew (5 of 91). large residuals among the items associated ^ 
with the five short passages. Three of these residua^s^ result from unexplained 
, (in terms of loadings on the operational tests' factors) relationships among 
the three questions about the first passage the short passage that contains 
the most technical terminology. 

Relationships among items for the two final passages in X^^ — 
both long — arc considerably less adequately explained by the extended 
'factors. All the residual correlations among items within each passage 
are greater than tlO and the preponderance greater than »20+ Test X^^ 
appears quite spee:ided when the last passage appears, so (as with test X^^^ 
it is difficult to say ^t^ether the xmexplained component reflects speed or 
ability to deal with the type of material contained in the passage. Since 
the residuals associated wlt^ items ^^elating ta this passage are considerably 
gre*ater in number and size in test than in the otherwise identical X^^^j 
It appears that tKe unexplained variance results primarily from a unique com- 
ponent of speed On the other hand, nk^st examinees do have tinas to consider 
the next-'to'last passage and it seems to contain ^n unexplained component 
related to its highly scientific/technical terms* Probably this unexplained 
vaTian<^e also results from a spe^d component, although nearly every examinee 
attemptad each item associated ^th th^ passage. That speed plays- a role becomes 
apparent by comparing the residuals among. this passage's items for tests X,^ 
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and X^2" Each residual from test Sc^^^ larger than the corre^f^*^ndllig 



residual from X^^' component is termed di^tn^wtivt ^ptzd^ 

i.e., the time spefac considering each item( 



V 




Results of Extension Analysis: Quantitative Inst^niments 

C^didaces receiving operational test form R2 were divided randomly 
Into fou'r subgroups. Each subgroup was administered a different 25'-iiiinute 
experimental mathematics instrument after compleclort of the three operational 
sections of the examination. These experimental testi' are based on different 
item tTpes, as -specified in Table 2 and sunnnarized in Table 9. 

"Table 9 

7 

Summary o^ Experimental Quantitative Tests 

- — • — — 

EJCperlmental ITo. of * A j 

m ^ . , f Description 

Tests Items ^ A 





^14 


r- 

30 


\ 

"cellar" items, no data interpretation 
items 






40/ 


- quantitative comparison items^ 






35 


quantitati^^'comparison ites^f followed by 
12 regular items 




^17 


20 


data interpretation items 



7 

For the present study, samples of 2,000 candidates were used for 
each subgroup* Table 1^ displays means, standard deviations, and correlations 
for these samples^ 
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Table 10 

Descriptive Scaciscics for Experimencal ^ 
Quancitacive Tescs 



Correration 



Test 


Ko^ of Icems 


Mean 




a 


V 




V 






16.47 








Q 


55 


' 32.43 


10.74 


,93 


,57 ' 






30 ' V 


14.91 


6.57 


;90 


.51 


90 


V 


95 


52.34 


16.15 


.94 


.56 




Q 


55 


32.68 


10,27 


.92 




^5 


40 


20.52 


8.19 


.91 


.47 


.87 


V 


95 


'51.75 


16.29 


.94 






Q 


• 55 


32.42 


10.40 


.92 


.58 




^6 


35 


17.52 


7.37 


.90 


.51 


,88 


V, 


95 


51.93 


16.42 


.94 






Q 


55 


32,38 


10.51 


.92 


.54 




^7 


20 


•10.63 


4,27 


:82 


,52 


,84 



The ineaiis* standard deviacians» and correlations of V and 0 scores 
Ihdicace Che four subgroups are highly comparable* with verbal means ranging 
from 51*75 Co 52*34 and quanCicacive maans from 32.38 to 32,68 — abouC two 
poincs higher than f or^ the form K quantica^tive nieans* V-Q correlations ranging 
from ^54 Co ,58- are ,03 to ,07 higher ch^ Che V-Q carrelacions obcained for 
form' K» a difference, signiflaanc for all buc the ^oup caking X^^, 

. Correlacions of Che experimencal cests wich verbal and quanticacive 
Cocal scores are also quice similar* ranging from .47 Co ,52 for che verbal 
score* wich quancitacive cotapariaon icems exhibiting che lowesc correlacion 
and daca incerprecacion icems che highesc correlacion Co che verbal score* 
and from ♦84 to *90 for che operacional quat^cicative cocair"wich regular icems sh, 
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the highest value data interpretatloa items the lowest^ Tests X^^ 
and , which contain quantitative comparison items, are interoiediate in 

correlation with the operational quantitative' score (r = ,'87 and .88, / 
respec^v^ely)* These differences are too small to be important'^ 
but their directions are consistent with item format differences and 
further corroborate the adequacy of the sampling*. The 10 factors of the 

operational test were ext^ded into the space of tetrachoric interitem correla- 
tions for each experimental test. Table H gives the proportions of variance 
accounted for by this procedure. Detailed extension loadings appear in 
Appendi;c D, 
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Table 11 

Variance of Experimental Quantitative Tests £}q>lained 
by Operational Test Factors 







^15 


^6 




* 

So* of Items = Total Variance 


30 


AO 


35 


20 


Common Variance* 


17. A6 


19.21 


17.37- 


9.32 


of Total Variance 


.58.19% 


A8.03% 


A9.-62Z 


A6.61% 


f ^ CU j^C * * f 1 MrUJM '11 V d 4 JL^Ul^ C 

Explained by 








• 


tlve) 


■ 67.06 


- 59.08 


57.03 * 


A6.28 


henslon)^ 


3.22 


A. 26 


"5.97 


A. 93 


tion 1) *^ 


6.68 


3.90 


5.27 


10.90 


Factor VII (Data Interpre- 
tation 2) 


,1.72 


1.97 


3.21 


8.86 


Factor IX (Quantitative 
Speed) 


A: 50 


; 5.59 


6.97 


A. 16 


' Subtotal (Percentage Common 
Variance) 


(83.18) 


^ (7A.80) 


(78. A5) 


(75. IJ) 


Verbal Factors HI* VIII, X 


A. 90 


^ 3.58 




A. 51 


Verbal Sp^ed Factors IV, V 


1.91 


3.07 




3.08 


Total (Percentage Common 
Variance) 


89.99 


81. A5 


86.A5 


82.72 


Percentage Tot^l Variance. 


52.37 


39.12 


A2.90 


38.56 



Common variance 'estimated as the sum of Tucker's adjusted highest off- 
diagonal estimates of communality. 
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It l3 interesting that tesc X^^ has' a higher proportion — over 
58% — of common variance than do other te^ts based other item formats* 
Test X^gf which contains 12 items sioiilar to those of test cat&e 
in a distant second* with common variance nearly 5QX of total variance. 
Test cons^ting of data interpretation itemsj, e:diibits the lowest proportion 

of communalltyt and tests involving quantitative comparison items occupy 
an intemediate position* For comparison t the operational quantitative 
testt containing a mixture of regular and data interpretation items, has a 
total estimated communality of 25. 80* or 46.91Z of total variance. 

Clearly, test X,,* consisting of items most like those of the operational 
quantitative test* has the mbst in common with that te8t~the general 
quantitative factor accounting for 67.06% of the estimated coioiDon variance of 
Xj^^, or 39.02% of its total variance* 

Test X^y, consisting solely of data interpretation items, shows lowsz 
relationship to the general quantitative factor, but has nearly 20%, of its 
common variance explained by the two data interpretation factors, VI and VII. 
Tests X^2 and containing quantitative comparison items* show a 

pattern of relationships to the factors that is g^erally more like ^ 
that of regular items than the pattern of data interpretation items. 

Factor IXt quantitative speed* represents that component of speededness ^ 
predictable from performance on the operational test. It is reasonable 
that test X^^^i^jJf/hoygh slightly shorter than X^^* shows a stronger 
* relationship to speededness on the operational test than does X^^, since 

the final 12 items on X^g are of the same type as the items In X^^ and those in 
the operational test « w^le X^^ consists entirely of quantita^tive comparison 
litems. Thus \^ oiight expect examination of residuals to provide evidence* 
of speededness unique to the quantitative comparison item type. 

ERIC ' ICJ - 
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keaidual Correlationa among Items wfthin Experimeatal * 
Quantitative Tests (X^^ j 

Residual correlations among items within each experimental test were 
exaoiined to determine vhlch, if any* relationships among items are not 
explained by the factor structure of the respective operational tests. 
Test which contains regular quantitative items most lik^ those in the 

operational test» seems to be thoroughly explained by the ten factors found 
in, form Of 435 residual correlations » only 12 are greater in absolute 

value than -10 and none is greater'^han .20. These residuals display no 
major relationships among the combinations of items with residual coronations 
greater than .10. There are a few interpretable relationships among pairs of 
items exhibiting residual relationships. These relationships are h ighly 
specific* however^ relating to the content of the items. For example>\two items 
dealing with areas of triangles in a coordinate geometry framework show 
a residual relationship* as do two geometry items dealing with angles. 
In test which contains ^0 quantitative comparison items* 32 

of the 780 residual correlations are greater in absolute value than .10 
(three are' greater than .20). Residuals among combinations o#- items 
suggest that two major components of test X^^ are not totally explained 
by the factors in form K2. One of these components* by virtue of high 
residual relationships among the final seven items (1^ of the 21 residual 
relationships are greater than * 10) * appears to be a speed factor that is 
distinct from the general quantitative speed factor extracted from tTie 
. Operational test. 
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The segPnd major unexplained relationship is interpreted to be an 
ability to <iS^l with data sufficiency items. Although there are no items 
classified as "data sufficiency" items in test X^^^^ the fourth suggested 
answer (choice D) for each quantitative comparison item in the test is "the 
relationship cannot be determined from the information given." Xq^a sense » 
'then» each item has a data sufficiency aspect. A data sufficiency component 
is suggestetf by the residuals Bwng the seven items for vM?ch choice D is 
the keyed response^ since a disproportionately high n\isber ^6 of 2I)>of 
the residual* relationships among these items are greater than .10. Because 
operational test contains no data sufficiency items > although fonn K has 
seven^ it is not possible to further test this interpretation* On form 



daca sufficiency items do not form a separate factor > bu^t^^^^^ear with data 
interpretation items. A nuiober of additional^ highly specific^ relationships . 
among pairs of items are apparent also. 

Test X^g» a mixture of quantitative comparison and regular quantitative 
items>^ exhibits residuals g^i^ter than ;10 in 43 of 595 cases. Of the 15 
pairs of residuals aiDong the six quantitative comparison items correctly 
keyed as choice D> five are greater than «10. This pattern is consistent with 
that found in test X^^ and gives further support to a data sufficiency 
int-etpretation. The pattern of residuals among the final items (24 ^of 66 
greater than .10) of this experimental test again suggests a component of 
sp^ed distinct ^rom ^he quantitative speed factor found in the operational test. 
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The residuals among items la test data incerpretacloa, 

suggest that a relationship among Che final five items is not adequately 
explained by tlfe 10 factors that were extended into this test. In all> 
25 of 190 residuals are greater in absolute value than .10. However, 8 
of the 10 residuals among the last five items are greater than .10 and 
^ are greater than .20. Interpretation of this unexplained component, 
howeve^^ is somewhat problematic since each ot th^ last five items is based 
on a rather unusual graph. The component is, therefore^ either a component 
of ^j^ed specific to this test> or a component underlying this atypical ■ 
graphic material^ or both. Since item statistics suggest that speed becomes 
a factor even before these last five items > .there is a strong temptation to 
attribute the unexplained variance to the unusual graphic material. Agaln^ 
as with the previously discussed experimental ' tests > a number of specific 
relationships among pairs of items remain unexplained, although jnany of these 
pairwise relationships are unlikely to represent generalizable variance. 
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Summary 

Structure of Operational Forms 

A factor analysis was obtained for each of the two GRE Aptitude Test 
forms administered in October 197S. These fonns appear to be representative 
of a lar^r number of GRE Aptitude last forms by virtue of the methods by 
which they were constructed and assembled. Input to the analyses consisted 
of item intercdVrelatlons amon^ all of the ISO verbal and quantitative items in 
Che operational ^^^j^Aof each test. The analysis of form K yielded an eight-factor 
solution which accounted for 9^% of the common variance and 38% of the total 
variance. A 10-factor solution, accounting for 95% of the common variance 
and of the total variance, was retained for form K2. Table 12 summarizes 
the factor structure of each form. The similarity of structure in tlie two forms 
Is apparent from the first three rotated factors, which ti^gether account for 
approximately three-quarters of the common variance in each form. These 
three factors — one quantitative and two verbal — represent the global 
skills tapped by the GR£ Aptitude Test. The quantitative factor is general 
in nature by virtue &t its high loadings on most pf the quantitative items. 
The two verbal factors define abilities to deal with connected discourse 
(reading comprehension passages and sentence completion items) and with 
words In isolation (opposites and analogies), respectively.* None of the 
remaining factors explain more than 10^ '(and most less than 5%) of the common 
variance. 

Additional similarities between the tw^ forms include factors involving 
Che speededness of each of the separately timed verbal sections of the tests, 
the speededness associated witn Section I (discrete verbal items) accounts 
for 6.2 and 7.7X of the common variance of forms K and K2, respectively, 
whereas the factor reflecting the speededness of Section II ( reading compre- 
hension passages) explains smaller pc^rtlons of common variance (2.S'^and 
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Table 12 



Summary of Factors Found in Two Operational Tjrms 



Factor 



Factor Name 



Form K 



K2 



I 
II 

III 

IV 



\ 



VI 



VII 



VIII 



General quantitative 

Reading comprehension: 
connected discourse 

Words-in-lsolatlon * 
vocabulary 

Elementary algebra 



Discrete verbal response 
speed (Section I) 

Data Interpretation 



Applications: word 
problems 

Reading speed: compre" 
henslon (Section II) 



General quakfljtatlve 

Reading comprihenslon- 
connected d/Lscourse 

Words -In- ls<^atioa;^' 
vocabulai 

Discrete Ver^aV jresponse 
3peed/(5|ction I) , 

Reading speed; comprehension 
(Section II) 

Data interpretation: ' 
extraction and 
manipulation 

Data interpretation:, 
extraction 

Reading comprehension: 
scientific/ technical 



IX 



Quantitative speed 
(Section III) 



Easy opposltes 
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4.4%» respectively). The less prominent factors appearing In each form are as 
follows; for form K> a factor accounting for sl;Lghtly more* than 4% of the 
common variance involves the ability to extract information from graphic or 
tabular material; f or , form IC2» two data interpretation factors underlying an 
ability to extract; information versus an ability to toth extract and manipu^a^e 
information* 

The remaining factors from each form highlight differences between the 
two forms in terms of their structure* A factor termed eZmmWiy algtb^^ 
which explains 7*5% of the cononon variance » appears In form K but not In form 
' IC2* This factor ±s defined not so much by the necessity to use algebraic 
manipulations to answer the questions » as by |he presence 'of algebraic 
notation * Comparable Items in form ^> Instea;! of defining a sgparate factor* 



show very strong lo^t^itj^s on the general quantitative factor* Form" K con- 
tains an addlJtional dimension reflecting an ability to solve verbally 
presented quantitative item$ (*'word problems" or applications)* 

The 10-fiactor solution computed for form IC2 contains^four dimensions 
that are not apparent in form K* These factors* each of whicb accofunts for 
about 4% or less of form IC2*s common variance* have been Interpreted* in ordev^ 
of t"heir emergence* as (l) an ability to both extract and'^manlpulate Information 
from graphs and tables* (2) an ability to comprehend scientific/technical • 
material* (3) an abdlity to work quickly In the quantitative domain* and (4) a 
skill ox response tendency related to opposites items* Factor (l) above> 
unlike the other data interpretation factor found In both forms* reflects an 
additional component of variation related to manipulating data extracted from 
graphs or tables or performing calculations based on tKbse data* j^actor (2)* 
a component underlying performance on Items associated with scientific/ 
technical reading passages^ appears as a separate factor In the analysis 
of form K2 but not in form TC> although* in both analyses* it^ms a^ociated with 
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^eclentif ic/technical passages have smaller loadings on the K^ading comp^zkzn4>J^n: 

J ' \ ^ ^ " . - 

"xartrtected dUCOUMt factor than do the items from noatechnical passages.* \ ^ 

A factor of quantitative speed, accounting for 2*5% of the common varianc 

emerges, clearly as a separate factor in form K?, although final quantitative 

items (i*e*, those not reached by all examinees) conti^e to display high ^ 

loadings on the general 'quantitative factor, s^gesting a relationship between- ' 

speed and ability in the quantitative dodalA. The final factor unique to forp 

K2 i$ a difficu^t-to-interpretfliompoiient characterized by loadings from the 

initial (and also the easi^) items, in each of %he opposites sections* 

Tftts factoi; has'l^^n referred to, therefore, a.a^ppo6itZ6 wWAjn-^up or\edUi/ 

*oppa^^€^, for lack of any more appropriate term* 

Structure of Experimental Verbal Tgstg 

In general, each df the experimental verbal tests is explained fairly 
well in terijs of the fattors extracted from operational form K* There are 
however J several interprj^^^^ dimensions of the experimental te^ts that are 
not ad^^uately explained. ^ ' ' 

Jest X.^ £s very veil explained, since more than 80% of its estimated 

Pi . < ' * ' ^ ^. h . * 

DiTvariiince has been accounted for by the ftight factors in th^e operational 

(52% is explkined by the i^eading comgpehension factor) and since t her ^ < ' 

\ < ' ' 

ark eXfiremely few significant Residual relationsifips among th^ items in this 
t4sJC: when the eight factors have been removed* The relationships among the 
iteks associated v^th the shorter, experimental passages (whpse content was ' 
humanitiesjf social studie^X ar^%s veil explained as thti longer passages used 
^'currant operational forms* This is not "Surprising, vhen.ve recall that 



the connected discourse factor displays loadings from operational ''passages,*' 
^s onej se^ 

-A 



as shor^^s^ onej se^t^^e, as veil as from , comprehension passages of standard 



-I* ^ 

length* The only unexplained component is a speed factor apparent from a 
disproportionately large number of significant residuals among the f ina^ ^ 
items i^jffUti test*' Interestingly enough* this component is distinct from the 
reading coiiq>rehension speed factor in the operational form. 

The second experimental verbal test* X^^^^* is siailar in content to X^^ * 
in every respect except number of items. That is» additional item is 
assocfiated^ with each passage in X^^y increasing the total number of items 
from 25 (in X^^) to 30. Adding these additional items seems to introduce a 
component that is not explained by the factors in the' operational form* 
About 5% less common variance than in test X^^q is explained for test X^^^^* end 
a proportionately greater number of significant resljduals are* found aiuong the' 
final items in test X^^^^* This suggests that a component ^of speed specific to 
this test has been introduced* An additional coii^onent of speed is suggestjed 
by virtue of tl^ relatively greater number of residuals among the shorter 
passages in this test than in X^^^* the shorter test* Since these items were 
.reached by virtually every examinee and since they are» except for tl^ree 
additional items* the same as those in X^^q* it appears that this additional 



component "Vf speed reflects the time that the examinee is afforded to ^ 
consider each item* This component has been termed dU^t^uhutivz 4>pzzd. 

Test J^2* 25-item test containing T}oth long and short scientific/ 
technfcal reeding passages^ is less adequately explained by the operational 
factors (76% of its common variance is explained) than test ^^q^ its non- 
scientific counterpart* Like tests X^^q and X^^y test ^^^^ ^ 
ponent of speed that is orthogonal to the reading comprehension speed component 
in the operational' forni*. Somewhat lower .loadings on the reading comprehension 
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factor and a higher fpro^njioa of large residuals suggest^ Chat, scientific/' 

* ■- 1p ' 

* " - ■ . \ ^ ' - 

technical passages contribute varlan<^e that is not well explained by th4 ^ 



operatidoal test's factors* vSartbennore, it apj>ears that the ludre, technical 
the passage > the greater thfe -variojice. ■ ■ ' 

Test X^^, the longer o£ '^he two tests containjipg s^iehtif Ic/t&chnical 
Hupassage^, is less thoroughly, explained by t^he o^jeratioaal test fa<?tars than 
any oftfae other tests 'Spiralled with'^rm K; only 65% of its conmjon variance 
is accounted for. Exaic^iiat^oQ of residuals suggests that this test contains 
th^ee 'dimensions not common tp the operational form. Two of tj^ese have been ^ 
Interpreted as ^peed factors distl^t from those in th^ operational test 



and *are consistenX^with. the Interpretatioi^ of factors In t^t ^ 
with test thev remaining unexplained dimension is related to the sclentiflq/. 

technical aspect of the passages. Overall, the variance of the tests containing 
scientif ic/technical reading passage items is not as well explained by the 
factors in the oj)erational test as the vai;iance of the« humanities^social studies 
passage items. This is attributed mainly' to their (the scienCific items*) lover 
loadings on ^oth the general verbal factors, although they load somewhat 
higher on quantitative factors th^ the humanities/social stxidies items. 

Adding items to the experimental tests b»oth the humanities/docial 
studies and the scientific/technical tests has the effect of increasing 
the portions of comnmn variance of the^ experimental tests not shaded 
with the operational form^ Increasing the length of the sciehtific/ 
technical tests seems to decrease this shared variance more then does 
lengthening the humanities /social studies tests. 
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Sttiicture ortecpep<fi& Tests 



The expetlififihtal qttantltative tests are, itL general, very well explained 
tbe operat^ional teat fac^or^ with which they ^are associated. In each 
caae the 10 opeV^ional factors ^explain more than 80^ of the estimated 
cojadion V*eiaq€e of/ Cfce" exp^imentaJr test* In fact, the^se of tes^'X^^, 
which cont4^-ns" items paralleling thft non-data- interpretation items now used 



In thft operational. tesCf fully 90% of Its commdrr'^iance was explained. 
Ex^nLtnatlpn of residuals f<^^j^^ reveals tha^ only xfej^ationsKips highly 
specific to pairs of items r^natn unexplained^^ . ' 

Test Xj^j Is the least we^ explained o^^'^tlEfe^ouTf^^^OTeT^ quantl* 
tatlve t9^ts> although'8i;E of X^s caramon variance is accounted for. Examin- 
atlon of residuals suggests t^^p^^inensions in this test that are not shared 




with the operational form K2. ISeither ditnension, ho\^er, is directly related 
to the ttem type (quantitative compari^n) foundtin the test«^ jOne dimension 
is a component of speed apparently dlsti&jCt front, the quantitative speed factor 

i ■ X 

itk the operational test» The second unexpl^aine^ 31sieiision underlies tKose 
items for which the correct response is "the-^relat^^^hip cannot be determined 
from the information given" — the final a^W>T^ in each of the items. This 
dimension, therefore, seems to be related, at le^6'%Ln4^ntial}.y) the data 



sufficiency factors that have/been found In te^ 
items. 



b&lcilng data sufficiency 



Test Xj^g, containing a mix of regular*^?cf .qij&jStitatlv^ comparison 




items, exhibits the same patterns of unexplained variance as tests X^ 
and X^^. The variance of test ^^7' ^^^^^ contains only data interpretation 
items, Is primarily explained by the general quantitative factor, but 
also to a lesser extent by the two data interpretation factors, which 
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account for nearly 20% of the tests' connnon variance. The cmiy unexplained 



dimension appears to underly items based on a rather unusuAl (atypic 
of usual data interpretation stimuli) polar graph having a ironlinear scale 
Whereas the cotnponent may possibly also be Interpreted as a Speed factor 
because of this graph's position at the end of the test> item statistics 
suggest the former alternative as more plausible. ^ 
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' The shortei; read;Lng comprehension passages have been found to add no 

V 

variance that is not shared with the common variance of the operational test^ 
In light of the finding that the reading^ comp?;^henslon portion of the cmxent 
t&st contains a component of speed independej^t pf ability in this domain. 



It sems reasonable- CO include a nmaber of shorter^ %j^s ages at or near the 
end of the reading comprehension section* Including such passa^s would 

V 

result in a smoother distribution of the number attempting eaofi Item, since 
fewer examined would be *'caii^t" reading a i^ssage upon expiration of the 
time limit* This smoother distribution should reflect slightly more adequately 
the assumed normality of the underlying trait. 

Recommendation Two ^ * 

Because inclusion scientific/technical reading comprehension passages 
r ^ * ■ 

and Item^ adds a cofiponent of variance Independent of ability to comprehend 

nonsclentif Ic (mjmanltles/soclal studies) passages. It Is recommended that 

the lf^llcations\^ any plan allowing examinees to choose among several types 

of passages be carefully considered, Studies to assess the differential 

validity of the two types of passages for examlnees'Tte tending to pursue 

scientific and nonsclentif Ic fields of ^udy seem to be i^i order* 

Recommendation Three 

Although the common variance, of tfhe experimental test containl^ quanti- 
tative comparison Items Is less adequately explained th^ for the other 
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' experimental tests, the unexplained variance of these Items does not 4JL^ctly 
reflect the Item typ^* Indeed, theie Items exhibit higher loadings on the ^ 
general quantitative factor than data Interpretation Items already In 
user It is recommended> therefore, that the decision to Includeor omit 
items of this type be based on considerations other than the factor . 
structure of the test. 

Recommeadatloa Ftyir ' . ^ 

Although distinct components of speed Vere found to be associated with 
each of the three sections of the operational forma^ the component found 
in Section I (discrete verbal itemis) is problematic because of its relatively 
large contribution to the test's total common variance* Since the .GRE 
Aptitude Test is purported to be primarily a power test, it is suggested that 
Section I be reexamined in light of its relative speededness — especially 
since speed and ability emerge here as uncorrelated traits* 

Recommendation Five 

It is recommended that the relevance of the results of this study for 
test development and assembly be noted* The structure of the GRE Aptitude 
Test, at least as It has been determined factorlally here, suggests that 
there are possibly useful and impo^^^ht dimensions that have not been con- 
sidered in the testes present content specifications* Furthermore, some of 
the classifications now used do not contribute to determining the test's 
factor structure* This does not imply that the item and co^ntent classifications 
^ now used are not of value, but that there are others that should also be 
considered in balancing test forms* Specif ic^ly, the following suggest 
themselves as important; ^ * 
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(X) Che presence of algebraic notation in quantitative items 

(2) the distinction between practical application word problems 
and quantitative items more theoretical in nature 

(3) the difference between data interpretation items requiring 
onl7*extractian of information and those requiring Both ^ 
extraction and manipulation of information 

(4) the value of the item option t3T>e keyed as correct (e*g*, the 

data sufficiency option type — "cannot be determined from ' - 

the information given" — in quantitative comparison items suggested 
itself as an additional dimension of variance in ^he present research)* 
In the interest of improving paralleliOT, forms K and K2 could be balanced 
with respect to these dimensions as well as on the item type requiring the examinee 

r 

to indlcate*which combination of inferences may be drawn from given Informa^ 
tlon. 

Recommendation Six 

Finally, it is recoimnended that this study be viewed in light of the explora- 
tory spirit in which it was undertaken* That is, the study was Intended feo result 
in a prelimi n ary factor analytic description of the test and a statement about 
the relationship^ of several experimental tests to the factors that>emerged in 
that description* More elaborate alternative approaches could have been Imple- * 
mented Instead of, or in addition to, those used in the present study. These 
could have included alternative methods of (1) computing interitem relationships 
(e.g*, phi or gamma coef f ici^nta) , (2) extracting factors and estimating com- 
munalities (e*g*, maximum likelihood or MINRES), and (3) rotating to simple 
structure (e*g*, Yates' geomln or oblique methods)* In addition, approaches 
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uslDg subsets o£ homogeneous items Instead o£ individual items might have also 
been informative, while avoiding some of the methodological difficulties associa 
with analy^^ based on indlvidtial itema. It is recommended > therefore > that 
these alternative types of analyses be conducted in the future when feasible* 
We like to believe^ however^ that> although alternative methods might have added 
to our current understanding of the structure of the GRE Aptitude Test, the 
operational Implications outlined 'in recommendations one to five above would not 
have been substantially different. 
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Appendix A 
fo^amples of Selected GR£ 
\ Aptitude Test Items 



ANALOGIES 

Ouestions ol this type te«t the zbtUfy to ond^ntand rdlatior>- 
$hip5 among words and ((teas. 

0/r»ct/on«^ In tach o\ tht following qotttlont, a rettl^ pair 
of wofd* Of phrases It lotlowvd by fivt Ittter^ pairs of words 
or phraaea. Seltd the lattofed pair whteh best exprestet a 
relaUonshIp tlMilaf to thai expressed In the original pair. 



1, COLOR : SPECTRUM (A) lone ftcaJi 
(8) sound ; waves {C) verse : p^am 
(0) dimension: space (C) ceU ; organism 

AKTONYMS 

Oueal^rts of this type test the exteni of the candidate's vocab* 
utery. ^ 



VERBAL 



i of ^v^rd 



OirecttonsrEach qoestfon befow consUts of e v^rd printed in 
capital lettefs. loliowed by fWe wordf or phrases lettered A 
through £* Cboosa the lettered word or phrase that U most 
nesriy opposite in meaning to the wo^d \n capital letters. Since 
some of the questions require yo^ to distinguish find shades 
of meaning, be sure I o consider all the choices belore decjdmg 
whEch one Is best ^ 



X PROMULGATE: (A) distort 
(0) retard discoursge 



(6} demote Xc\ suppr^ 



SENTENCE COMPLtTlON -■""^'ri.../. 
This type of Question provides a measure of one aspect ol 
reading comprehension the ability to recognize tOQ^cal ar)d 
stylistic consistency among the elements m a sentence ^ 

0^/tctfons. £ach ol the sanlences befow has one or more blank 
spsceSf each blank indicating that s word has been omitted, 
Benesth Ihe sentence are Rve lettered words or sets of words. 
YoM are to choose the one word or set of wrords which, when 
inserted in the senlence» best fits In with Ihe mesning of the 
sanlence <s a whole. 

e. Early — of hearing toss Is — by the fact that man's other 
senses are able lo compensate for moderate amounts of 
fosSt so thai he fraqoantiy does not Know that hia hearing 
la imperfect ' 
{A) dtacoveryJndlcaied {6) d«YalopmenL.pfeYented 
(C) detectton^comPllcated (0) treatmanL.facltItated 
{£) IncidancaLxorrected 

7. Swamp drainage la used to prevent or at any rale to 
the breoding of malarta^bearlng motquftoest 
(A) and (8) remedy (C) postpone w 
Inhlbft (C) exclude ^ 
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flEAOlNG COMPREHENSION 
More than hart o' the^st^ng t^me *or Ihe verbal sectio 
SRE Aptitude Test ts devoted to reading comprehen; 
/eading passages are taken from a variety of fields, a 
»Ag compreher^Sion is tested at several jeveis. Som 
questions merely test ^nderstand.m^oHbe ptam sense 
has been stat^ Olhers ask for *nterprelatioh. analysi 
piicatiof) of the OnncipJet or op»n.ont expressed by \hi 

O'/ectfons: Esch passage U fottowed oy questions ^ 
Its conlent After resding th^atsage, choose the best 
to aachjquestion. Answer alF^ueslions foliowing a pas 
the iiasEs of what it stated or ^mpff^ in that passage. 

in the years following ihe Civil War, economic expi 
for the^rst 4ime waa provided whh adequate resource 
competent technique, and busy prospeclors were daily 
aring new sourcea of wealth. The coal and oil of Panm 
and Ohio, the copper and iron ore of Upper Michigan, i 
, and silver, and tjfie lumber and fisherfes of the PaciUt 
provided limlliess raw malerlals for the rising Indusi 
^Tha BaAemer process quickly turned an age of Iron 
age of steal and created Ihe great, mills of PIttaburs 
which Issued the raita for expanding r^itways. The reai 
"binder. Ihe sulky plow, and the threshing machine cr* 
large^aie agriculture on the fenlfe prairies. Wild gr* 
provided grazing lor Immense herds of callie and she 
deveiopmant of Ihe com belt enormously Increased the 
of hogs; and with rsHwaya at hand the lyilddfe Border 
Into Omaha and Kanaaa City and Chicago ai/endles« 
of produce, ' * / 

".'"Xs'lheTTne oTlhe'rrdhireVpVshelJ wesWar new tow 
^ buiit, thousanda of claima'lo homesteads were filed, am 
tifstor snd promoter hovered t)vefMha'ffal?le*-Hke bt 
seeking their carrion. Wilh'rising land values money wa 
^ ntadf, out of unearned Increment* and the creation of 
was a>qfitable industry. The times were stifrlng; and 
^ a shiftiesa felktw who did nol nrake his pile. If he had bt 
' lata to^fife on dtorjSble acres, he had only to find a cj 
homesteader who had failed In some legal technlcafi 
"Jump hIa ^lalm." Good bdttom land could be had e 
late*comars If they were sharp-at the game. 

This bustling America of 1$7Q accounted Itself a dami 
worid. A f^ee people had pul away all arislocrallc pr^ 
^ and, conscfous of power, had gone forth to possess ti 
frontier But America's essential soQial philosophy, w 
found adequate to Its naada, waa aummed up fn three ^ 
preemption, exploitation, p^ograa'a. tts Immedlale and pr 
buslnesa waa to dispoaaeaa the government of Ita rich ho 
Lands In Ihe possession of the goveinrhent were so mut 
wesle^ untaxed and profitlesa; In private handa they 
*ba developed. They would provide work, payJaxeat s: 
schools, enrich the community. Preempt ion meant axpio 
and axplofiallon meant progress* 

It w« a simple philoaophy and It aulted the almp/e U 
ualTam ol the times. The Gilded Age knew nothing of anil 
maol; II racognli^d only the acqulalthre'inatlncL That 
at faaat the frontier h^d taught the graat American demo 
and in apptying to the resources ol a conllneni the let 
had been so well taught the Qtided Age wrote a profc 
. charidariallc chaprar'of American history* 



rr±g^t(E)1970 by Educ4t±onal Testing Service* .All rlfits reserved* 
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'B, AeeofdUig 1o ^ ptSM^i* incrit»#d com production 
malnfy rnpotttibJi for in lnor*tsi tn ihi 
(A) mimlm of shatp (8) Output of firm Implofnint* 
(C) luppfyofhogi (0) amount of pasUire Uod 
(E) number of eattio 



9, According lo pasiagi* ihi progrm of 1hi 1670« dt* ^ 
pind«d mainly on 

(Af thi »ltlinei of fich gov«mminl |«nd hotdlnfs 
(8) thi fpmd of ftdueatlon 

Jc\ ihed«Yttopm*hl ori phHotoptiy of tndlvtduaUtm 
PH^iio dttv«lopm«ni of nalunl rt^ourcn 
(£) iht^iminttton of ^liiiocratte pHviJ#$*5 

10, Ttitf^thor tmplie* that the social phlloiophr of tho United 
Sti4t in thi 1BT0t wat bsdicaHy 
(A) humanbtle (B) n^iefUUftte (C) ■rlttocrttte 
(0) democrtUc (E) hypocdtlctl 



11, A» used by thi i^uthor, tholerm ^GHded Ago" rifvrt to «n * 
■go of 

(A] social progress *(a) intoileetual enltghtenment 
* (C) frontier living (0) graat lortunes 
(E) arisioeralk prMl^go 

}Z Wtlh which of Ihe following aphorIsms>fOuld the axplollart 
of the 1870s probably have bean In strongest agrooment? 
\ ^) A penny saved js a penny aamed. 
\ (B) Kothtng ventured, nothing gained, 
I (C) Grasp all* lose all 
/ ' (0) Ha who dances must pa^ |he fiddler/ 
(E) The love of money Is the rool of all evtL 



D'rocifonsrtn this section soh^e esch problem, using any avsll* 
sbie spece on the pege tor scraicfi worit Then Endlcate the 

best aitswer In ^he appropriate space on the mswer sheet 

J-* 

f4ote;Rgures which accompany problems are Intended to pro- 
vide information useful in sofving the problems. They sre 
drawn ts accursiejy as possible ejcept when 11 is stated In a 
specific problem thai its figure Is noi drawn to scale, AU figures 
fie in s plane uAiasa othemrlse indicated. ' 

All numbers used sre real numbers* 

.i^X If p, q, and r sre confecutWe whole numberSt which of 
the fouowfn^ must be true? 
(A) p q -i- r Is even. (8) p 4- q 4* r Is odd, 
PQr Is even* (0) pqr Is odd, , y*^ 
4f p q ^ r Is odd, then m Is odd. 



Questions 14-ig refer to the following graph. 




14. A rule ot thumb say* that the systolic pressure should be 
'^s^e plus one hundred " At which ol [he following ag^s 
does thie nile ot thomb dlHsr most Irom the dsta for hesvy 
msles? 

(A) 20 (Q) do (C) 40 (0) SO (E) 60 
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15. Wh«t I> th« man puls« prmur* of a Qght mil* «9td 407 
(AM4 (B) 30 (C) 39 (D) 44 (E) 53 

16* Wh«l l« lh9 youngest age for ^htch maan btood prataur« 

can ba t«ad trom tha 9t^? 
, ^-4^(9)4 (O 7 (0)9 (E)17 ^.^-^ 

17. >1 wtiich of rha following ages ts tha^maan pulaa prtaaura 
grtalttt? 

lA) 4 .(S) 17 (C) 40 (D) 65 (E) 75 

IC Of tha following, whteh if the heel e*timara of the ^ean 
pressure of**aivefaga welghr' malaa aged 307 
(B) 40 (C) 53 (D) 04 (E) 124 

Id. What ^ the percent^ fn crease* to the nearest parcer)t, in 
tha mean syiiotlc pressure for heavy mataa ffom the *9e 
of 50 10 tha age of SO? 
(A)V/» (B) VU (q 4V* (0) 8*/» (E) 10*/# 



20. If the co*t fOr manufacturing / artlciea was M dollars In 
1964 and N doltara mora In what waa tha Incraaaa 
In cost, tn doltara par arifcle?^ 

r 



low tna >9ira 
^ -pti{sa press 



2Z tt I ot the mambert of a committee Voted on a c 

3 

measure and passed 11 by a vole of 26 to 24* what p) 
(10 ihe nearesi percenl) of ihe entire commillaa vc 
favor of Ihe measure? 

(A) 3S*/* (B) 48''/o (C) 5Z*A (D) 67*/* (£) 7$*/* 

23. Given thai ^ and b are real numbers and b ^ 
' 0 (a, b) =: I and M (a, b) = a 
Then M (0(3,12), M{e,2)) 
(A) I (B) I (O 3 (0) 12 (E) 48 



(A) 



(B) 7 te) g (0) 



(E) m 





r 



24. The area of reclangle PQRS above \% 43, qv = VR 
PT TS. If poini M Is somewhafa fnside the red 
PQVT. an^lf ' tha area of triangle MRSt which ^ 
foltowing Jncfudas all the values and only the values 
(A) 6 < X < 24 (B) 12 < X < 24 (C) 12 < x '< 
(0) 24 < X < 48 (E) 48 < X < 06 



21. Whal \t tha area of iriangia PQR in the ffQure above7 
(A) 6 (B) 12 (q 18 (0) 24 (E) 36 



\ 
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Appendix B 
Description of Tucker's Procedure 
for Estimating Communalities 
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Appendix B* 

Description of' Tucker's Procedure for Estimacing Communalicies ^ 

Tucker's adjusced h^ghesc off^diagonal correlation provides a conmnmalicy 
esclmace obcained by pulciplying theihighest off-diagonal correlation, Xj, , 



betweep^^AP target^ variable^ j,'and other variables by a weighting constant. 

^ > The constant is a ratio with' ni^ar atpr equaJL to the sum of the^bsolute 
values . l^^jj^j 1^ >^ j > l^ujj and d^^ffinator^qual^Jto the sum of the ajjsolute 

values i^i^l j> Thus, of the pair of variables j^H^,*'the 

variable exhibiting higher correlations with all other variatjNf^ the system 
receives the hlghei^i^coimnun/lity estimate. In the case of a uni factor matrix, 
or a higher dimensional macrix in trtiich the two variables are collinea^ and ^ 
differ oaly In len-gth, this escimace is exact,, sia^e we can rocatd^so ^hac both 
valuables have aoazero loadings oa factor oae aad zero ^oadlngs oq all others, 



leading to the following expression, where p is the Bumber of factors and 

is the factor loading of the kth variable on the pth factor:- ' 

4 / . 



r ^hii-iv* la^.i, ivf ^^^^^ ^ . , 

J k 

Clearly^ this procedure is less appropriate when high correlations^ obtain 

^ ' ■, * ^ 

among non^ollinear items and is not robust in the face of doublet variance^ The 

'sum of these estima't^s\ should provide a^^donable estimate of total conmiu^^lity 
if doublet variance is not an important source of item colllnearity. \ 



Then' h 



TJiis derivation 4s from Carlson ^1976)/ 9ince documentation on thia 
i^roti^dure is not wldttly available, it is presented here. 
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Appendix C 
Structure of Operational 
.Tests K and K2 
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(Form K, Swtlon I) ^ 

It^ Trpt Ittn Ifttabgr I_ II til H S 21 7X1 VIII ^mupaXlqr Cocapmallty 

,1. , 45 27 28 

, ' 1 ' 34 3e . 35 ^2 

3 26 25 ' 22 i5 

6 26 47 ' 32 

7 .30 ' 14 16 

8 ' .29 14 * 13 

9 39 * U . 





10 




55 


36 


55 


49 




U 


10 


29 


56' 


53 


M 




U 




34 


34 


27 


25 




13 
14 




28 
31 


67 ^ 


19 ^ 
56 


14 
56 




15 






63 


57 


55 . 




16 


18 




46 


33 


32 




17 




24 


62 


47 


46 




^ IB 






44 


18 






19 


4 




53 ■ 


28 





20 » 63 ^ 46 52 

n 52 34 . 43 40 . 



ft 



22 55 43 , 57 53 

3«iic<ace 24 40 23 +34 i9 

CcpUtl^ ^5 a 3? 24 31 27 

. . 26 26 24 .17* , . 14 

17 34 62 * 54 JT^ 

28 ^49 42 ' 51 I . *5 




29 • 41 25 , a ' 35 \ 

30 42 62 ST 57 

31 25 ^ ^13 

32 44 41 *? 40 
S ^ 30 52 . JI 39 

34 32 55 .45 ^ 

35 27 45 20 ^ 33 35 

36 ^ 33 4V 23 15 ^ 

37 ' 38V 10 "17 



. ^38 32 3r^ 24^ 3X 43 ^ 

39 ^ 29 48 28 49 

40 30 57 52 49 

41 29 63 a 57 54 
t /w™**;** 42 ' 34 54 25 ^ 55 - 52 

Oppomtt^ -43 .55 -. 34 36 

44 128 49 . . a ' ^ 42 . 

45 29 71 a '67 *5 
' ^ 4^ ' 66 U , 52 



47 59 



29 ■ * 39 



4V' 21 23 a- ^ 68 1 ' !i 

49 ' . 28 33 ^ 26 ' 558 ' 

4^ 38 5B ^ ' . ^ 2 



50 

^1 22 60 



52 , - lit ' ^ *3 , ^7 

caution. - U . 23 51 « ^ 3 

\ J5 , 2t *6 . *0 . *3 ^5 



■7" 




tbsD .20 (tod «U a«clMl pQlQt*) bm b^n ovicc«^ 
frov ctilj «n3 4ll fubicqucnc BtbUt^ ^ 
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Rotated F&ctor Loadings^ 
(Form K, Section Il5 ^ 



XtCT'Type Item 5umber I 



Factor 

Zatloated "CoopiAtod 
XX IXX IV V 71 7IX VIXX CoaBBijnalitv ComEronality 



I 

2 
3 

4. 
5 
$ 
7 



41 
46 
50 
31 
23 
43 
57 



24 



24 



23 
27 
30 
12 
12 

P 
34 



22 
25 
32 
U 
B 
26 
41 





- d 


45 




21 


23, 






'46 




29 


25 


HupanltiftS 
Fu««ge 


10 

U 

12 ^ 


50 
47 
60 




34 
33 

39 ^ 


31 
29 
42 




13 


44 




22 


22 




14 


45 


23 


34 


?o 




15 


3d 




18 


17 


Argui^atlve 


U * 
17 


35 
39 


29 


26 

' ' 27 


27 
22 


Faswgi^ 


Id 


63 




45 


48 




19 ' 


43 


^4 


33 


29 




20 


/ 44' 


37 


' 36 


37 



Biological 
F&ftsaga 



21 
22 
23 
24 
25 
26 



25 



41 
38 
27 

.29 
30 




Socl^ Scudiea 
Passage 



27 
28 
29 
30 
SI 
32 
33 



21 



46 

46 

64 

50 <* 

50 

29 

36 



26 



22 



Fhjsical 

Science 

Passag*' 




25 



21 
22 



44 
36 
48 
50 
34 
35 
25 



1 

21' 



/ 



72 




Xot«tcd Factor Loaains*. 
(?or» 5«ctlim III) 



Item T7P« Iten Htntber 


I 


H 


III IV 


V VI 


vn 


VTTL CDfDtm*HtV 


CotEBunftllt^ 






30 




3d 






31 


. 28 


Alftbrm 


2 


29 




24 






22 


22 


Arlcbaetlc 




26 




^ 59 






46 


55 




4 


42 










25 


25 


ArltlMtlc 


5 




27 


45 








* 35 ' 




( 


53 


25 


47 




30 


70 


67 






27 


'23 




21 


38 


23 


26 




8 


51, 


22 


47 






56 


54 


Arlcfamtlc 


9 


46 


23 


49 






37 


51 


10 


36 




r> 
^4 




25 




3d 




ix 


49 


22 


45 






58 


54 




















tmtlon (bl) 


u 


20 


26 




54^ 




63 


44 


01 


13 




27 




46 




45 


35 


01 


14 


26 






31 




24 


21 


01 '* 


15 


38 




23 


31 




33 


34 


01 


16 


54 


27 


25 






48 


4e 


ArlcttBttlc 


1^ 


44 




23 


41 






45 


42 




Id 


44 










30 


28* 




19 ^ 


' 63 




30 






51 


55 




20 


3^ 


25 


47 






. 40 


43 




21 


49 


31 


48 






69 


60 


01 


22 


25 


25 




49 




50 


39 


01 


23 


30 


25 




58 




69 


' 50 


DI 


24 


43 


30 




30 




54 


43 


01 * 


25 


29 


3d 


26 


33 






44 


01 


26 


26 






22 






14 


Arltbaetlt 


27 


55 






21 


23 


if 41 


44 


Arltfattitlc 


28 


42 








21 . 


^ 31 


26 




29 


' 52 


- 


35 






44 


43 




30 


40 




22 




t 


25 


. 25 




31. 


51 


27 






21 


44 


45 


GaoMtiy 


J2 ■ 


63 




3d 






65 






33 
3^ 


43 
43 


23 


21 






35 
26 


\33 ' 
l22 




35 


39 




22 






31 


28 




36 


51 




2d 






47 


39 




37 ' 


57 










47 * 


38 . 




3d 






29 






70 


60 / 




39 


45 










35 




Arltfattitlc 


40 


54 










36 


- 32^ 




41 


55 










34 


36 


01 


42 


40 










28 


23 


01 


43 


46 


23 




22 




45 


36 


01 




66 










53 


54 


01 


45 


56 










48 


41 


.01 


46 


50 










iz 


28 



( 



KIC 



CMMCry 47 

Al|«bn 48 

<0vmmxxj ' 49 

G«MC]rr 50 

Ml> c ^ lt *a #o os 51 

Hl«cAUim*ous 52 

Kl«e«llAa«oiu 53 

CtcMtry 54 

t^Mtllxo^Ottt 55 



?«rc«at of 



63 
*79 
67 
66 
77 
80 
80 
77 
83 



-28 
-21 



40 
62 
55 
46 

89 
89 
61 
87 



^*3 26.7 21.4 7*5 6.2 4.3 3.1 , 2,5 



44 
66 
49 
48 
75 
74& 
75 
'63 
75 



I 
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Tible C-4 

Ro^AC^ti ?«ctor Loadings 
, fPorp K2, SecClon 1) 





It«9 Hufiber 


1 


II 


III 17 


7 VI m wii IX 








1 








V 




22 




2 




36 








16 




3 


22 


33 


23 


t 




* 21 








36 


48 


* 




34 




5 




22 








1(J 




6 


22 


' 44 


43 






40 




7 




21 


61 






50 




8 






56 . 






48 




9 * 






45 






20 




10 




52 




27 


31 


46 




u 


35 


34 


25 




29 


62 




12 




*o 


39 






31 




13 






52 






35 




14 * 




22 


40 






27 




1$ 


27 




40 






34 




16 






57 






' 35 




17 






66 






40 




18 




29 


53 






36 




19 






65 






37 


* 






55 








31 




Zl 


Zo 


^ c 
*5 












22 




39 


40 






37 




23 
^4 
25 




49 
42 
33 


25 
21 

24 ^ 






33 
26 
16 




26 




31 








21 




27 




30 


35 






26 








31 


22 


1 




14 




ir 




46 








37 








39 


33 






37 






22 










17 




32^ 






43 






19 




, 33 




35 


65 


t 




57 




34 


26 


24 


36 






33 




35 






51 


i 




29 




36 




32 


62 






56 




37 






69 






40 



Cftttomulity 



f20 
\l7^ 

37 
' 9 
43 
42 
35 
23 



40 
J4 
33 
35 
27 
29 
35 
46 
%^ 
44 



38 
34 
34 
36 
26 
IS 
15 
25 
^5 



32 
30 
12 
^4 
56 
28 
26 
53 
47 





21 


37 


. 22 


39 


^9 




46 


37 


27 






37 


2a 


3^ 


'41 




35 ■ 


50 


26 


42 




38 


4l 


21 


43 




21 


$4 




U 






35- 


21 


"45 




23 


68 


ii 


46 






59 




' 47 






52 




4a 




23 




89 


49 


21 


25 




85 


JO 


20 


30 


22 




51 


21 


21 






52 


27 




42 




53 - 










54 




22 


30 




55 











22 



33 
26 
38 



51 
63 
64 
60 
36 
59 
35 
57 
39 
32 



49 

58 

41 
34 



S»tfnc< 
Cti^l«tioaft 



84 
94 
93 
67 
82 
59 
52 
51 



71 

li 

62 
50 
37 
59 



ERIC 



74 
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UbU C-S 

Botatad ?ttcter Laadingfl 
(Torm X2f S«ctloa II} 



^ Factor 
It«» Typft Item Hupbar i II m S V VI VII VIII K 



Sarrstfve 
Funga ^ 

6 



S3 

49 
51 
56 
34 



23 



27 



Sc l eatl f lc 
Paaaaga 

(BiocbwlstxT) 



7 

8- 

9 
10 
11 
12 
13 



34 36 
^ 32 

27 31 
30 28 
31 
28 



20 



14 

Argouneative 
(Social Studies 

19 

* 20 



20 



25 



27 
49 
49 
42 
62 
31 
39 



21 
33 
25 
2Z 



Sisaaltlea 
PaaaagA 

(Syntbaaid) 



a 

22 
23 
24 
25 
26 
27 



20 



26 



S3 

42 ^ 

SS 

5S 

43 

28 

A4 



23 
23 

3S 
28 



fttaaoltias 
Paasag* 

(Kythfrlogy) 



2r 

29 
30 
31 
32 



26 
22 



24 



SS 

60 

49' 

47 

33 

20 

44 



30 
28 

24 

24 
26 



4S 
47 
47 
47 

38 
28 



20 



£ EBtlaated Conputi 

3S 33 

^0 28 

' 32 2S 

• ' 30 34 

31 3S 

25 16 



SS 
36 
42 
42 
26 
50 
15 



13 

4S 
70 
14 
30 



39 
16 
37 
39 
27 
22 
38 



38 
69 
49 
38 
IS 
19 
47 



38. 
23 
30 
29 
23 
17 
12 



12 
34 
40 
34 
4S 
12 

a 



.33 
19 
40 
39 
24 
20 
3S 



38 
60 
43 
34 
16 
12 
41 



i — 


3S 


■ 23 


33 


20 


60 




S7 


■ 4« 


Tbyvical , 


36 


2& 


32 


23 


S8 




69 


49, 


Scieaca Padsa^ 


37 


28 


37 


23 


64 




79 


S8 


(Gaolosr) 


38 




27 




48 




39 


32 


39 




29 


26 


S3 




S6 


42 




40 ■ 


2S 




25 


48 




40 


3S 



ERIC 



75 



4 
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Tiblt C-« 

totAtfid Factor tMdlngs 
(F^ZB tZy S^tloa III) 



Axlthoetic 2^ 

Arlthaetic 5 
AxleiMtic 6 

Aflthzutlc 7 
Arltlmtlc 8 
^ Axlebectic 9 

Arltbtt^tic iC 

Ceo»*tr7 H 

Algcbtft 12 

Ugtbn 13 , 

Aflttnetlc ^ 15 

C«Mltt7 , ^* 16 

Hl«c«ll«QeDur 17 - 

Ugebr* IB 

HfrnctTlan^ttJ 19 

Uscbn 20 

Afitfaaetlc 21* 

G«ov*^t7 ' 22 





II 


is 






35 


42 


23 


44 


28 


37 


23 


5^ 




55 




32 


26 


39, 


27 


57 


21 


56 


20 


5a 




57 


23 


77 




6d 




52 




42 


33 


47 


20 


35 


27 


75 




38 




75 





in TV 



VI VII Till 



II X Eatlttftted CotBputed 



Alg«b» 
C«o«ittt7 

AfitbMtlc 
C«o«ittt7 

Algcbn 



31 
32 
33 
34 
35 

37 
38 



63 
52 
64 

35 23 

62 

73 

77 . 
59 ■ 



Al^bja 

C«o«ittt7 

ArithMtic 

ArltbMtic 
Algcbn 
' AlgtlKm 



45 

46 

47 

48 

49 i 

SO 

51 

52 

53 

54 

55 



46 23 
54 
61 
68 
64 
67 
76 
69 
40 
62 
43 



21 
24 



-26 
>-24 



26 



24 
25 
33 



27 
23 



45 
44 
24 
31 
32 
26 





26 


63 


69 


33 


97 


36 


18 
j« 


23 




48 


43 


41 


39 


23 


19 


37 


29 


50 


43 


40 


39 


32 


36 


56 


49 


7a. 




56 


53 


28 


28 


32 


30 


33 


28 


26 


22 


57 


60 


18 


19 


60 


61 



Dt ta>Xn te TP r** 
















tatiim (DI) 


23 


32 


25 




6fr. 


64 


51 


Ot 


24 


34 


30 




60 


63 


47 


01 


25 


41 






a 


71 . 


46 


01 


26 


25 






42 


29 


22 


01 


27 


37 




44 




53 


37 


01 


28 


40 




za 


32 


44 


38 


01 


29 


39 




24 


34 


44 


38 


DI 


30 








23 


25 


16 



45 
39 
50 
24 
48 
61 
71 
40 



43 
32 
46 
12 
5 
58 
65 
41 



01 


39 


22 




30^ 




25 


19 


DI . 


40 


43 


41 




%' 


57 


^ 37 


DI 


41 


37 


43 




52. 


39 


DI 


42 


50 


44 




68 1 


52 


DI 


43 


47 


40 






47- / 


44 


01 


44 


38 


36 






38 ' 


31 



35 
41 
51- 
58 
65 
78 
95 
57 
38 
60 
46 



33 
41 
U 
54 
46 
6S 
77 
59 
31 
59 
il 



?«TC«nt of cxxKnon 



29.7 22.7 19,4 7,7 4.4 4,4 3.9 J.l 2.5 2,1 



ERLC 



7G 
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Table C-7 

■ i 

Principal Factor Solution 
Roots and Variance Contributions 
for Forms K and EC2 







1 


V 








Form K- 




Form K2 


Factor 


Root 


Ct^Dulative Percent of Total 
ConzmDn Variance 


Boot 


GumuiatUve Percent: of Tc 
ConziBDn Variance 


I* 


33.07* 


55.2 


35.35 


55.1 


II 


10.27 


, 72.4 


•9.58 


70.0 


III 


4.84 


' 80.5 ■ 


4.44 


77.0 . 


IV 


. 2.25 


* 84.2 •■ ■ 


3.11 


81.8 


V 


1.89 


87.4 


2.01 


84,9 


VI 


1;70 


90.2 ^ 


1.85 




VII ' 


1.22 


'92.3 


1.34 


90.0 . 


VIII 


1.04 


■94.0 


1.10 


91.6 


IX 


.85 


95.4 


1.08 


93.3 


X 


' .83 


96.8 


.97 


94.8 


XI 


.81 


98.2 


.82 


96.1 



XII ,74 -99.4 ' .80 97.4 



Table C-7 (ContO 
Additional Roots 



Form K Form K2 



Factor Root - Root 



13 


.64 




. .68 


U 


.61 




.64 


15 


,56 


- 


.62 


16 


.51 




.54 


17 


.49 




.51 


18 


.47 




\46 


13 








20 


.42 

; 




.42 

• 


■ 

77 


■ 

.00 * 




■ 

- ,01 


78 


.00 




.01 


79 


-.01 




.00 


80 
■ 


-.01 




-,01 

* 


137 


-.30 




-,30 


138 


-.31 




-,30 


139 


-,32 




-.31 


140 


-.33 




-.3i 


141 


-.33 




-.-32 


142 ^ ' 


-.34 

> 




'"-.■33 


143 


-.34 




-.34 


144 


-.35 




-.35 


145 . 


-.37 




-.36 


146 


-,3-7 ^ " 




-,38 


147 


-,38 




-.39 


l48 


-.41 




-.40 


149 


-.4i 




-.'44 


150 


-.48 - 




-.46 



Table C-8 

Soota and Variance Contributiona for 
Botated Factora - Form K 



Factoid 



Boot 



Percent of 
CotmDon Variance 



CuntuLativ 
Percent 





15.94 


^ ^ 28.3 


28.3 


11-^ 


15.05 


26.7 


55.0 


III 


12.06 


> 21.4 


76.4 


IV 


4.^0 


7.5 


83.9 


V 


3.51 


6.2- 


90.1 


VI , 


2.39 


4.2 


94.3 ' ■ 


VII 


1.72 


3.1 


97.4 


VIII 


i.42 
56.29 


2.5 


99.9 


4- 


Boota 


Table C-9 

and Variaace Contributions for 
Botated factors - Form K2 





Factor 



Root 



Percent of 
Coamon Variance 



Cumulative 
Percent 



I 


18.14 


( 


• 


29.8 


29.8 




13.75 






22*6 


'52.4 


III 


11.83 






19.4 


71.8 


rv 


4.69 






7.7 


79.5 


'■ V 


2.69. 
> 






4.4 


83.9 


VI 


2.59' 






4.3 


88.2 


VII 


2.38 






' 3.9 


92.1 


VIII 


1.88 






^3.1 


95.2 


(EX . 


1.53 






2.5 


^97.7 


X 


1.35 
60.83 






2.2 ; 


99.9 


^ ^ 




79 







r 
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Appendix D 

Factor Extension Matrices for Experlinentai Verbal (X 



10 



Experimental Quantltat^^ve (X^^ - X^^) Tests 



80 



ERIC 



) 
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Table D-1 



Factor Extension Matrix 
for Test 



Factor 



Item Type 


Item Number I 


' 11 


III 


17 ' 7 VI VII VIII 


Short Passage 
One 


1^ 

2 

3 


• 42 
. 29 




20' 


I- 

Short Passage 
Two 


•4 

5 


46 
49 
29 






Short Passage 
Three 


7 ' ' — 

-I ■ 


52 
^58 

, 48 


26 





Long Passage 
One 



toog Passage 
/ . Two 



10 


1 


53 


36 


11 




41 




12 




56 




13 




53 


28 


14 




51 


26 


as 




37 




16 
17 




?2V 


26 
23 


18 




52 


26 


19 




28. 


20 




142 


31 


21 




49 


40 


22 . 




39 


33 


23 




47 




24 




34, 


36 


25 




48 


39 



20 22 



21 



22 




ERIC 



r 
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Table D-2 

Factor Exteasloa Matrix 
for Test 



Factor 



Item Type ^ Item Kumber 



Short Passage 2 
One / 3 



II III IV 



VI . m. VIII 



70 
22 



20 





4 




30' 


40 








• 










w 




46 






1 wo 


7 




^ft 








8 






^ 22 






a 

7 
























1 ft 




JH 






Short Passage 
Three 


12 




55 


22' 


- 




13 




51 


31 






1* 




40 








15 




54 






Long Passage 

One ^ 


16 


20 


50 


22 




17 




48 


'24 




18 




41 




21 




19 




51 


22 






20 




A9 


31 






21 




58 




28 . 




22 




43 


34 


\ ' ' 

22 




^3 




37 


30 






24 




44 


33 




Loag Passage 
Two 


25 


23 ' 


46 


39 ' 




26 


24 


47 


35 




27 


. 23 


40 


32 






28 


22 


45 


' 35 


> 




29 




30 


33 






30 


< 27 


• 42 • 


38' 


23 



o 

ERIC 



82 



i 4 
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' Table D-3 

^acto^ .Exteaslon Matrix 
for Ta4t ; 



r 



1/' 



Factor 



Item. Type Item* Nomber 
Short Passage 



1- 

2 . 



■^6 24 . 24 
24 * ■ 

51' ♦ 



short Passage 



Short Paasaga 
. Three 



8 
9 




v^5 ^22 

■24 ' 45 ■ • 



21 



Long Passage 
One I 



10 
11 
12 
13 
14 
15 
16 
17 



23 41 
' ^7 
46 
77 

23 53 

28 43 
23 58. 



'21 
23 























- 18 






• 52 




■ 3-7 






19 




- 37 


n 










ZO 




32 










Long Passage ^ 
Two 

t 


2X 
22 
23 




25 
27 
36 


'48 
48 
37 


24^ 
•22 • 


, 2.7 






24 




■ 46 


37 


^1 






* • 


25 




^ 32 


42 


25 


■23 • 



1 



Item Type Item Humber 



" 73 - 

Table p-4 
Factor Extension Matrix 

L3 



for Test X^^ 



Shor^t P^ssaj^e 



1 

■2 
3 



Factor 

I 11 III V VI yil 

' 22 -4^ . 24 
' 22 • ^ 



<^"Snbrt Passage 
Two 



?a^£ 

3 



"4 

5 . 

6 * 



50 
49 



21 



7 



Short PdddAffe 


7 




25 
.39 




* 






H Short Passage 
Four 


9 

10 

11 ■ ^ ■ 


23 


44 
26 
38 






^ 






12 
13 














Short .Passage 
* Five 




41 

'47 


21 
21 


21 








St 
















IS . 




38 












i« 




50. 






26 




^^ong Passage 
One 


17 
18 
.19 


22 


46 
57 
51 


22 


21 








. 20 




'45" 


*■« ' 






■ 21 




21 




38 


- 23 






- 21 




22 




48 


21 






• 27 






. 27 


'43 


.23 


20 




30 


Long -Passage 
Two ^ 


25 ■ ^ 
,^27 


37- 
3Q 
25 
30 


33 
42 
39 ' 

•5o 


24^ 
28 


A ^ 


*• 

i 

21 






■ 28 


28 


3C^ 


-31 










29 "; 


39 


25 


25 










30 


^30 


32 


' , 31 




23 





84 



- 74 - 



Table' D-5*&r 



Factor Jxteasiaa Matrix 
for Test Ti^^ 



Factor 



ERIC 



Item Type 
r 



RfegUlar 



ItAi Sumber 
1 

. 2" . . 

3, . 
' 4 

5 ' 

■ ^ 

8 _ 
.•*9 

12 

■ 13 
14 
15- 

V • 16 
- 17 
; 18 

' 19 
20" 

n 

22 - 
23 

-24 ' * 

27 • ■ 
' 28 
29 
30 ■ 



I III IV V VI VII 



VII VIII 



63 25 • 
63 . . ' 
•48 
65 25 . 
71 V 
68 
82 
69 

' 65*" ■ 

. 74 V 
6g 

4>. ' ■ 39 
72\ , ^ 
59 \ 
52. 1 
56 ' 
58 
76 
77 
59 ■ 
57 

76 .... 
-53 " 

62 ' 
4^ 

63 . 
55 



33 



23 



33 
34 



28 



^ 27 



25 
■29 



85 




33 

35 
30 

42' 



- 75 - 



Itfeia/TTP^ 



'Item Number 



titati 



CofflparisoQ 




■1 
2 
3 
4 

■^ 

1-7 
8 • 

9 
10 
11 
12 
13 
14 
15 
16 
17 
18 
19 

2a 

21 . 

22 < 



25 

[29 
' 30 

31^ ; 

32 

33 
'34 

35 

36 

37 

•;?8 

39 * 

40 



Table D-6. 



Factor. Extension Matrix 



for Test 



5^ 



I. n III 



47 
41 ' 
52 
60 

38 " 
^7 
58 ^ 



31 
26 
20 



64 
40 
58 
51 
55 
52 
59 
58 
54 
55 
■41 
63 
72 
62 
^7 

50 
^ 65 
55 
61 

*56 
57 
45- 
51 
' 27 
53 
52 
37 
34. 

51 

*48 



26 
27 



1^ 



Factor 



-21 

y -21 



VII VIII 

21 " 
' 22 



26 



IX X 



25 



.*'21 



V 



A. 

4 



26 
21 




23' 



30 
34 

h 

21 
26 
29 
28 
26 



28 



86 



Iten Type 



Quantitative 
Conparlsoa 



Table l>-7 ' " . 

F^tor Ertexislon KatrlsE 
^ ' for Test 



Item Ntimber 

. 1 
2 



4 
5 
6 
7 
8 
9 
10 
U 
12 
13 
14 
15 
16 
17 
18 
19 
20 
1% 

23 



41 
47 
64 
54 
55 
53 
58 
49 
56 
37 
65 
56 
49 
45 
65 
62 
52 
55 

48 
62 
52 



II III IV 

38 
31 • 
32 

31 
25 
28 



20 



Factor 



VI VII VIII' 



IX 



C 

s 

22 
23 



♦21 



23 

.X- 



Regular 
' Quantitative 



24 

25 

26- 

27 

28 

29" 

30 

32 
i3 
34 
35 



* 31 

'71 
41 
59 
60 
65 
40 
40 
44 
^6 
58 



22 
26 




24 

31 
33^ 
31 
26 ■ 
22 



^8 



34 



^25 



29 
27 

52 ' 
2.7 
,'28 




Table D-8 

Factor Extension Matri:; 
for Test X^^ 



\ 



0' 

Item Type Item Sumber I II III IV V VI VII VIII ^ 



Daca 
InterpTetation 




1 . 47 ' ■ 20 / -21 

2 35 .. ■ . 

,3 -'59 

4 48 ■ ' ' 

5 31 '23 ' 
■ 6 25 

7 -42 ' 

8 ■ 44 21 

/ 9 ' 46 " 25 



ID 39 ' 

11 36 21' ; 

12 54 . ■■ 25 22 ■ 

13 50 23 32 
14' 54 37 
15 ' 53 27 
16' * 50 * 28 
12. 53 

18 '41 39 70 37 

19 r49 24 . » 

20' 56 ^ ' 31 



\ 



f > 
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